00000001:02000400:0.0F:1787380134.856044:0:2955:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787380153.270787:0:3176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787380155.012887:0:3233:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 509 MB/s 00000001:01000000:3.0:1787380155.268964:0:3233:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 696 MB/s 00000001:01000000:0.0:1787380155.519205:0:3233:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3819 MB/s 00000020:02000000:0.0:1787380156.314294:0:3268:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_116_gc06913e 00000400:02000000:0.0:1787380157.390631:0:3283:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.206.114@tcp [8/256/0/180] 00008000:02000000:3.0:1787380160.766174:0:3433:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1787380208.460001:0:5238:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787380217.253391:0:5767:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787380217.253398:0:5767:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787380217.253536:0:5767:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000b429a487 00000080:02000400:1.0:1787380217.253552:0:5767:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787380217.258723:0:5767:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787380217.258734:0:5767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787380217.258769:0:5767:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000041c454e4) 00000020:00000080:1.0:1787380217.258788:0:5767:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787380217.274986:0:5767:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787380217.276084:0:5767:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787380217.299500:0:5767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787380217.299546:0:5767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787380217.299570:0:5767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787380217.299616:0:5767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787380217.299641:0:5767:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787380217.300014:0:5767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787380217.300022:0:5767:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787380217.300032:0:5767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d1188420ee 00000020:01000004:1.0:1787380217.300039:0:5767:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787380217.300043:0:5767:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787380217.300047:0:5767:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b429a487 from MGS 00000020:01000004:1.0:1787380217.300051:0:5767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787380217.300060:0:5767:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c2ea857f) 00000020:00000080:1.0:1787380217.300070:0:5767:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787380217.300117:0:5767:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b429a487 from MGS, refs=2 00080000:01000000:1.0:1787380217.300122:0:5767:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787380217.300126:0:5767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d1188420fc 00000100:00100000:1.0:1787380217.300223:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787380217.300483:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787380217.300491:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787380217.301622:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787380217.301632:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787380217.302296:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380217.302957:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787380217.302964:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787380217.303735:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787380217.303742:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787380217.304029:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787380217.304035:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787380217.304859:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380217.304864:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380217.304865:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380217.305107:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380217.305109:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380217.305110:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380217.309993:0:5767:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787380217.314053:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0F:1787380217.559389:0:5767:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3167 MB/s 00000001:01000000:2.0:1787380217.809496:0:5767:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3843 MB/s 00000001:01000000:2.0:1787380218.059525:0:5767:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 623 MB/s 00000001:01000000:1.0:1787380218.309913:0:5767:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 611 MB/s 00080000:10000000:0.0:1787380218.319929:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787380218.345170:0:5767:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787380218.345187:0:5767:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787380218.345189:0:5767:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787380218.347525:0:5767:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787380218.347579:0:5767:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 10000000:01000000:0.0:1787380218.350244:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00000040:00080000:1.0:1787380218.350541:0:5767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787380218.350613:0:5767:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787380218.351208:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380218.351398:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787380218.351404:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787380218.352636:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787380218.352646:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787380218.353163:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787380218.353171:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787380218.354448:0:5782:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787380218.354483:0:5767:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787380218.354504:0:5767:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.114@tcp' 00000020:01000004:0.0:1787380218.354506:0:5767:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787380218.354565:0:5767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.114@tcp (typ=mgc) 00000020:00000080:0.0:1787380218.354583:0:5767:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.114@tcp (0000000048cd0a70) 00000020:00000080:0.0:1787380218.354600:0:5767:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787380218.355083:0:5767:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e99a16cd@MGC192.168.206.114@tcp: add connection 192.168.206.114@tcp at head 00010000:00010000:0.0:1787380218.355238:0:5767:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.114@tcp-0 is initialized 00000040:01000000:0.0:1787380218.355245:0:5767:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787380218.358041:0:5783:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787380218.358108:0:5767:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.114@tcp (uuid 8aaaa441-7de5-4747-b366-e84ba9a288bb) 00000020:00000080:0.0:1787380218.358130:0:5767:0:(genops.c:1406:class_connect()) connect: client 8aaaa441-7de5-4747-b366-e84ba9a288bb, cookie 0x651a07d11884210a 00000100:00080000:0.0:1787380218.358142:0:5767:0:(import.c:510:import_select_connection()) MGC192.168.206.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380218.358147:0:5767:0:(import.c:624:import_select_connection()) MGC192.168.206.114@tcp: import 00000000e99a16cd using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1787380218.358198:0:5767:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d4a0517c x1874203935506560/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380218.358219:0:5767:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS 00000020:01000004:0.0:1787380218.358234:0:5767:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787380218.358239:0:5767:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787380218.358258:0:5767:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000049ae49d1) 00000020:00000080:0.0:1787380218.358271:0:5767:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787380218.358486:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d4a0517c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aaaa441-7de5-4747-b366-e84ba9a288bb:3298:1874203935506560:0@lo:250: 00000100:00100000:2.0:1787380218.358536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380218.363671:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935506560 00000100:00100000:3.0:1787380218.363684:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935506560 00000100:00100000:3.0:1787380218.363739:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380218.363746:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db6b5463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1874203935506560:12345-0@lo:250: 00010000:00080000:3.0:1787380218.363769:0:5779:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 8aaaa441-7de5-4747-b366-e84ba9a288bb@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1787380218.363805:0:5779:0:(genops.c:1406:class_connect()) connect: client 8aaaa441-7de5-4747-b366-e84ba9a288bb, cookie 0x651a07d118842118 00000100:00080000:3.0:1787380218.364125:0:5779:0:(import.c:65:import_set_state_nolock()) 00000000fef04b9b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380218.364239:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db6b5463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:3298:x1874203935506560:12345-0@lo:250: Request processed in 492us (5702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380218.364247:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380218.364701:0:3298:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.206.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787380218.364711:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.114@tcp: connect to target with instance 0 00000100:00080000:2.0:1787380218.364717:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787380218.364721:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787380218.364724:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000e99a16cd MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787380218.364726:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787380218.364739:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787380218.364744:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d4a0517c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aaaa441-7de5-4747-b366-e84ba9a288bb:3298:1874203935506560:0@lo:250: 00010000:00010000:3.0:1787380218.366126:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380218.386925:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380218.387559:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787380218.387578:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787380218.393582:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380218.393655:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787380218.400255:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787380218.400268:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787380218.401190:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380218.401327:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787380218.401330:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787380218.402793:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787380218.402803:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787380218.436538:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380218.436821:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787380218.436828:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787380218.439275:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787380218.439287:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787380218.440085:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380218.440235:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787380218.440241:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787380218.440851:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787380218.440858:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787380218.442110:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380218.442298:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787380218.442303:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787380218.443540:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787380218.443551:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787380218.444236:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380218.444669:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787380218.444675:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787380218.445285:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787380218.445292:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787380218.495532:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380218.495748:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787380218.495756:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787380218.500318:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787380218.500335:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787380218.501453:0:5767:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787380218.501464:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787380218.503710:0:5767:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787380218.503738:0:5767:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787380218.503743:0:5767:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787380218.504245:0:5767:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787380218.504283:0:5767:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.114@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787380218.504287:0:5767:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787380218.504289:0:5767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787380218.504290:0:5767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380218.504291:0:5767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380218.504292:0:5767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380218.504294:0:5767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380218.504295:0:5767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787380218.504297:0:5767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787380218.504298:0:5767:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380218.504299:0:5767:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380218.504300:0:5767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380218.504301:0:5767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787380218.504304:0:5767:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787380218.504307:0:5767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787380218.504308:0:5767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787380218.504309:0:5767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380218.504310:0:5767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380218.504311:0:5767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380218.504312:0:5767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380218.504313:0:5767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787380218.504314:0:5767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787380218.504315:0:5767:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380218.504316:0:5767:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380218.504316:0:5767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380218.504318:0:5767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787380218.505451:0:5767:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787380218.505561:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000213404b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935506688:0@lo:253: 00000100:00100000:1.0:1787380218.505697:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380218.505856:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935506688 00000100:00100000:0.0:1787380218.505864:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935506688 00000100:00100000:0.0:1787380218.505930:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380218.505938:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baa93057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:5767:x1874203935506688:12345-0@lo:253: 20000000:01000000:0.0:1787380218.506001:0:5781:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787380218.506004:0:5781:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:1.0:1787380218.506128:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 0000000029cfcf16 going to sleep for 11 seconds 10000000:01000000:1.0:1787380218.506795:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787380218.506856:0:5781:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787380218.507263:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380218.508817:0:5803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787380218.509222:0:5781:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787380218.509227:0:5781:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787380218.509232:0:5781:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787380218.509235:0:5781:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787380218.509248:0:5781:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787380218.509938:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380218.510247:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787380218.510259:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787380218.510305:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787380218.510428:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787380218.510470:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787380218.510645:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787380218.510654:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787380218.510705:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787380218.510712:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787380218.510742:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787380218.510749:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787380218.510779:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787380218.510829:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787380218.510865:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787380218.510871:0:5781:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787380218.510885:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380218.511780:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787380218.511799:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787380218.511847:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787380218.511881:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787380218.512617:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787380218.512637:0:5781:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787380218.512767:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787380218.512775:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787380218.512816:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787380218.512848:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787380218.512876:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787380218.512886:0:5781:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787380218.512979:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787380218.512989:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787380218.513021:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787380218.513055:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787380218.513247:0:5781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787380218.513298:0:5781:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787380218.513305:0:5781:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787380218.520662:0:5804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787380218.521455:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787380218.521483:0:5781:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.114@tcp for mdt 20000000:01000000:1.0:1787380218.521486:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.114@tcp (null) (null) (null) 00000040:00080000:1.0:1787380218.521520:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787380218.521527:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787380218.521551:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787380218.521558:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.114@tcp (null) (null) 00000040:00080000:1.0:1787380218.521628:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787380218.521638:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787380218.521667:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787380218.521697:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787380218.521757:0:5781:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787380218.521760:0:5781:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787380218.521763:0:5781:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787380218.521775:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787380218.521778:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787380218.521813:0:5781:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787380218.521816:0:5781:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787380218.525697:0:5805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787380218.526059:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787380218.526105:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787380218.526189:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787380218.526202:0:5781:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787380218.526205:0:5781:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787380218.528457:0:5806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787380218.529174:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787380218.529228:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787380218.529258:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787380218.529272:0:5781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787380218.529274:0:5781:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787380218.529278:0:5781:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787380218.529289:0:5781:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787380218.529295:0:5781:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787380218.529301:0:5781:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787380218.530203:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787380218.538060:0:5781:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787380218.549774:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787380218.549822:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787380218.549888:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787380218.549906:0:5781:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787380218.549925:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.549940:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.549949:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.549954:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.549960:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.549967:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.549973:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000769e0e3 already unused, calling callback (00000000cbd99c93) 00010000:00010000:1.0:1787380218.549976:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.549996:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.550008:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.550014:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.550019:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000769e0e3/0x651a07d11884211f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380218.550035:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787380218.819963:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baa93057 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:5767:x1874203935506688:12345-0@lo:253: Request processed in 314018us (314257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380218.819985:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380218.820095:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000213404b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935506688:0@lo:253: 10000000:01000000:3.0:1787380218.820123:0:5767:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787380218.820127:0:5767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787380218.820129:0:5767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787380218.820131:0:5767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380218.820132:0:5767:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787380218.820133:0:5767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380218.820134:0:5767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380218.820135:0:5767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787380218.820137:0:5767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787380218.820138:0:5767:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787380218.820139:0:5767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380218.820140:0:5767:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787380218.820170:0:5767:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b429a487 from lustre-MDT0000 10000000:01000000:3.0:1787380218.820193:0:5767:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787380218.820196:0:5767:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787380218.820200:0:5767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d9695a5b380 10000000:01000000:3.0:1787380218.820203:0:5767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787380218.820210:0:5767:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d9695a5b380 from 1 10000000:01000000:3.0:1787380218.820212:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787380218.820263:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 0000000050cc3b21/0x651a07d118842126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.820274:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 0000000050cc3b21/0x651a07d118842126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.820282:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 0000000050cc3b21/0x651a07d118842126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380218.820298:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000008650c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935506816:0@lo:101: 00000100:00100000:3.0:1787380218.820436:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380218.820493:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 000000008ac28f53 going to sleep for 11 seconds 00000100:00100000:0.0:1787380218.820557:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935506816 00000100:00100000:0.0:1787380218.820564:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935506816 00000100:00100000:0.0:1787380218.820608:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380218.820615:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000943453f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:5767:x1874203935506816:12345-0@lo:101: 00010000:00010000:0.0:1787380218.820627:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380218.820640:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f15c493a/0x651a07d11884212d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842126 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380218.820662:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f15c493a/0x651a07d11884212d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842126 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380218.820672:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f15c493a/0x651a07d11884212d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842126 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380218.820680:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f15c493a, rc 0) 00000100:00100000:0.0:1787380218.820715:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000943453f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:5767:x1874203935506816:12345-0@lo:101: Request processed in 102us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.820721:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380218.820797:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000008650c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935506816:0@lo:101: 00010000:00010000:1.0:1787380218.820809:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 0000000050cc3b21/0x651a07d118842126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.820817:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 0000000050cc3b21/0x651a07d118842126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380218.820873:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935506944:0@lo:501: 00000100:00100000:1.0:1787380218.820897:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.820922:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0a053b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787380218.820975:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935506944 00000100:00100000:0.0:1787380218.820979:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935506944 00000100:00100000:0.0:1787380218.821006:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380218.821012:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e3cc2c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:5767:x1874203935506944:12345-0@lo:501: 00000100:00100000:0.0:1787380218.821229:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e3cc2c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:5767:x1874203935506944:12345-0@lo:501: Request processed in 217us (330us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380218.821243:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380218.821320:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935506944:0@lo:501: 10000000:01000000:1.0:1787380218.821450:0:5767:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787380218.821467:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: 0000000050cc3b21/0x651a07d118842126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.821475:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: 0000000050cc3b21/0x651a07d118842126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380218.821481:0:5767:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d968b549800 10000000:01000000:1.0:1787380218.821485:0:5767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787380218.821489:0:5767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d968b549800 10000000:01000000:1.0:1787380218.821491:0:5767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787380218.821494:0:5767:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d968b549800 from 1 10000000:01000000:1.0:1787380218.821496:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787380218.821513:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 000000000769e0e3/0x651a07d118842134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.821519:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 000000000769e0e3/0x651a07d118842134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.821525:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 000000000769e0e3/0x651a07d118842134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380218.821536:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507072:0@lo:101: 00000100:00100000:1.0:1787380218.821563:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.821582:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0a053b1 going to sleep for 11 seconds 00000100:00100000:3.0:1787380218.821645:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507072 00000100:00100000:3.0:1787380218.821649:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507072 00000100:00100000:3.0:1787380218.821689:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380218.821695:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ace74ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:5767:x1874203935507072:12345-0@lo:101: 00010000:00010000:3.0:1787380218.821703:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380218.821712:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005363871a/0x651a07d11884213b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842134 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.821726:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005363871a/0x651a07d11884213b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842134 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.821735:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005363871a/0x651a07d11884213b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842134 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.821742:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005363871a, rc 0) 00000100:00100000:3.0:1787380218.821770:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ace74ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+7:5767:x1874203935507072:12345-0@lo:101: Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380218.821776:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380218.821898:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507072:0@lo:101: 00010000:00010000:1.0:1787380218.821908:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 000000000769e0e3/0x651a07d118842134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.821915:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 000000000769e0e3/0x651a07d118842134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380218.821938:0:5767:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787380218.821951:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: 000000000769e0e3/0x651a07d118842134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.821957:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: 000000000769e0e3/0x651a07d118842134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380218.821962:0:5767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787380218.821965:0:5767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380218.821969:0:5767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d968b549800 10000000:01000000:1.0:1787380218.821972:0:5767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787380218.821974:0:5767:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787380218.821976:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787380218.821988:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 000000000ccee75a/0x651a07d118842142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.821994:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 000000000ccee75a/0x651a07d118842142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.822000:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 000000000ccee75a/0x651a07d118842142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380218.822014:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507200:0@lo:101: 00000100:00100000:1.0:1787380218.822039:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.822061:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0a053b1 going to sleep for 11 seconds 00000100:00100000:3.0:1787380218.822614:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507200 00000100:00100000:3.0:1787380218.822621:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507200 00000100:00100000:3.0:1787380218.822659:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380218.822665:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060d27add pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+7:5767:x1874203935507200:12345-0@lo:101: 00010000:00010000:3.0:1787380218.822675:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380218.822683:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fe46995/0x651a07d118842149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842142 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.822698:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fe46995/0x651a07d118842149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842142 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.822705:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fe46995/0x651a07d118842149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842142 expref: 8 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380218.822723:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fe46995, rc 0) 00000100:00100000:3.0:1787380218.822769:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060d27add pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+8:5767:x1874203935507200:12345-0@lo:101: Request processed in 104us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380218.822776:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380218.822899:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507200:0@lo:101: 00010000:00010000:1.0:1787380218.822910:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 000000000ccee75a/0x651a07d118842142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380218.822928:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 000000000ccee75a/0x651a07d118842142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380218.822971:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507328:0@lo:501: 00000100:00100000:1.0:1787380218.822996:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.823065:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0a053b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787380218.824711:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507328 00000100:00100000:0.0:1787380218.824724:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507328 00000100:00100000:0.0:1787380218.824831:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380218.824839:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bccc4bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+8:5767:x1874203935507328:12345-0@lo:501: 00000100:00100000:0.0:1787380218.825179:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bccc4bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5767:x1874203935507328:12345-0@lo:501: Request processed in 340us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.825187:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380218.825286:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507328:0@lo:501: 00000100:00100000:1.0:1787380218.825327:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507456:0@lo:503: 00000100:00100000:1.0:1787380218.826688:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.826741:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0a053b1 going to sleep for 11 seconds 00000100:00100000:3.0:1787380218.826810:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507456 00000100:00100000:3.0:1787380218.826817:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507456 00000100:00100000:3.0:1787380218.826866:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380218.826874:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083f8b979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5767:x1874203935507456:12345-0@lo:503: 00000100:00100000:3.0:1787380218.827062:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083f8b979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5767:x1874203935507456:12345-0@lo:503: Request processed in 188us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380218.827069:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380218.827180:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507456:0@lo:503: 00000100:00100000:1.0:1787380218.827662:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5809:1874203935507584:0@lo:502: 00000100:00100000:1.0:1787380218.827700:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.827730:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096104939 going to sleep for 11 seconds 00000100:00100000:3.0:1787380218.827779:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507584 00000100:00100000:3.0:1787380218.827784:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507584 00000100:00100000:3.0:1787380218.827813:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380218.827819:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3c4ea15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5809:x1874203935507584:12345-0@lo:502: 00000100:00100000:3.0:1787380218.827963:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3c4ea15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5809:x1874203935507584:12345-0@lo:502: Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380218.827970:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380218.828010:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b7600008 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5809:1874203935507584:0@lo:502: 00000020:01000000:3.0:1787380218.828030:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380218.828041:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380218.828043:0:5809:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787380218.828048:0:5809:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787380218.828050:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380218.828071:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bf297e68) 00000020:00000080:3.0:1787380218.828088:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787380218.828100:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787380218.828219:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787380218.828228:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d118842157 00000020:00000080:3.0:1787380218.828668:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787380218.828673:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380218.828677:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380218.828678:0:5809:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787380218.828681:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380218.828685:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380218.828686:0:5809:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787380218.828689:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380218.828694:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000fc65def6) 00000020:00000080:3.0:1787380218.828704:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787380218.828708:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787380218.828710:0:5809:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787380218.828713:0:5809:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787380218.828719:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787380218.828760:0:5809:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b429a487 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787380218.828769:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f10b4fc1) 00000020:00000080:3.0:1787380218.828776:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787380218.828813:0:5809:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787380218.828818:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d11884216c 00000020:00000080:3.0:1787380218.828907:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787380218.828911:0:5809:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787380218.828915:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x651a07d118842173 00080000:01000000:3.0:1787380218.828919:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787380218.828922:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d11884217a 00080000:10000000:3.0:1787380218.829296:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787380218.830450:0:5809:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787380218.834918:0:5809:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787380218.911099:0:5809:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787380218.912119:0:5809:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787380218.917881:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787380218.918555:0:5809:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787380218.943999:0:5809:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000873a010e) 00000020:00000080:2.0:1787380218.944023:0:5809:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787380218.944096:0:5809:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787380218.944104:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d118842188 00000020:00000080:2.0:1787380218.944646:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787380218.946039:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380218.985867:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380219.018701:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380219.049703:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380219.096904:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787380219.136422:0:5809:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787380219.172619:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x651a07d11884218f 00000020:00000080:0.0:1787380219.173061:0:5809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787380219.173072:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380219.173078:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380219.173081:0:5809:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787380219.173083:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380219.173087:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380219.173088:0:5809:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787380219.173091:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787380219.173093:0:5809:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787380219.173096:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380219.173098:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380219.173100:0:5809:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787380219.173102:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380219.173106:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380219.173107:0:5809:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787380219.173111:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787380219.173169:0:5809:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787380219.173221:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001309466c pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5809:1874203935507712:0@lo:502: 00000100:00100000:0.0:1787380219.173295:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.173434:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4aeeaad going to sleep for 11 seconds 00000100:00100000:1.0:1787380219.173500:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507712 00000100:00100000:1.0:1787380219.173507:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507712 00000100:00100000:1.0:1787380219.173550:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380219.173558:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6124ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5809:x1874203935507712:12345-0@lo:502: 00000100:00100000:1.0:1787380219.173917:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6124ff9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5809:x1874203935507712:12345-0@lo:502: Request processed in 359us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380219.173926:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380219.174501:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001309466c pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5809:1874203935507712:0@lo:502: 00000020:01000000:2.0:1787380219.174534:0:5809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380219.174540:0:5809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380219.174541:0:5809:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1787380219.174546:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787380219.174725:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787380219.174748:0:5767:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787380219.174804:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: 000000000ccee75a/0x651a07d118842142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.174814:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: 000000000ccee75a/0x651a07d118842142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380219.174821:0:5767:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d968b549800 from 1 10000000:01000000:3.0:1787380219.174824:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787380219.174852:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.174860:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.174868:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380219.174883:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000046cb54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507840:0@lo:101: 00000100:00100000:3.0:1787380219.174924:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380219.174959:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057dc6d11 going to sleep for 11 seconds 00000100:00100000:1.0:1787380219.175025:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507840 00000100:00100000:1.0:1787380219.175030:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507840 00000100:00100000:1.0:1787380219.175066:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380219.175072:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c64b939 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:5767:x1874203935507840:12345-0@lo:101: 00010000:00010000:1.0:1787380219.175082:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380219.175094:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842196 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380219.175112:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842196 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380219.175120:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842196 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380219.175128:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076b533dd, rc 0) 00000100:00100000:1.0:1787380219.175177:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c64b939 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:5767:x1874203935507840:12345-0@lo:101: Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380219.175183:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380219.175256:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000046cb54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507840:0@lo:101: 00010000:00010000:2.0:1787380219.175279:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.175286:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380219.175941:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507968:0@lo:256: 00000100:00100000:2.0:1787380219.175988:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380219.176013:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 000000003cbcfdc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787380219.176667:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935507968 00000100:00100000:3.0:1787380219.176675:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935507968 00000100:00100000:3.0:1787380219.176722:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380219.176729:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d196ec92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:5767:x1874203935507968:12345-0@lo:256: 20000000:01000000:3.0:1787380219.176748:0:5781:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787380219.176753:0:5781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787380219.176828:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d196ec92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:5767:x1874203935507968:12345-0@lo:256: Request processed in 99us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380219.176835:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380219.177058:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935507968:0@lo:256: 10000000:01000000:2.0:1787380219.177897:0:5767:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380219.177960:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.177970:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380219.177978:0:5767:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d968b549800 from 1 10000000:01000000:2.0:1787380219.177981:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380219.178013:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.178020:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.178028:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380219.178042:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508096:0@lo:101: 00000100:00100000:2.0:1787380219.178083:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380219.178117:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 000000003cbcfdc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787380219.178183:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508096 00000100:00100000:3.0:1787380219.178188:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508096 00000100:00100000:3.0:1787380219.178230:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380219.178236:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c623a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:5767:x1874203935508096:12345-0@lo:101: 00010000:00010000:3.0:1787380219.178246:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380219.178258:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188421a4 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.178275:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188421a4 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.178284:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421a4 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.178292:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac12c8af, rc 0) 00000100:00100000:3.0:1787380219.178329:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c623a41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5767:x1874203935508096:12345-0@lo:101: Request processed in 93us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380219.178463:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508096:0@lo:101: 00010000:00010000:2.0:1787380219.178473:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.178481:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380219.178533:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508224:0@lo:501: 00000100:00100000:2.0:1787380219.178557:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380219.178572:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 000000003cbcfdc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787380219.178602:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380219.178623:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508224 00000100:00100000:3.0:1787380219.178627:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508224 00000100:00100000:3.0:1787380219.178640:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787380219.178644:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ed0ad6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5767:x1874203935508224:12345-0@lo:501: 00000100:00100000:3.0:1787380219.179218:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ed0ad6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5767:x1874203935508224:12345-0@lo:501: Request processed in 572us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380219.179227:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380219.179840:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508224:0@lo:501: 00000100:00100000:2.0:1787380219.179875:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508352:0@lo:503: 00000100:00100000:2.0:1787380219.179919:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380219.179989:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 000000003cbcfdc7 going to sleep for 11 seconds 00000100:00100000:1.0:1787380219.180050:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508352 00000100:00100000:1.0:1787380219.180055:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508352 00000100:00100000:1.0:1787380219.180125:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787380219.180133:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec89c2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5767:x1874203935508352:12345-0@lo:503: 00000040:00080000:1.0:1787380219.180180:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380219.180229:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec89c2e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5767:x1874203935508352:12345-0@lo:503: Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380219.180235:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380219.180297:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fb5bb81a pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508352:0@lo:503: 00000040:00080000:3.0:1787380219.181121:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787380219.181270:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787380219.181298:0:5767:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380219.181316:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.181327:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380219.181395:0:5767:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787380219.181398:0:5767:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d968b549800 10000000:01000000:0.0:1787380219.181401:0:5767:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d968b549800 10000000:01000000:0.0:1787380219.181404:0:5767:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787380219.181410:0:5767:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d968b549800 from 1 10000000:01000000:0.0:1787380219.181412:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787380219.181438:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 000000002e80f322/0x651a07d1188421b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.181446:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 000000002e80f322/0x651a07d1188421b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.181454:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 000000002e80f322/0x651a07d1188421b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380219.181469:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508480:0@lo:101: 00000100:00100000:0.0:1787380219.181508:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.181926:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d299f452 going to sleep for 11 seconds 00000100:00100000:2.0:1787380219.181987:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508480 00000100:00100000:2.0:1787380219.181993:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508480 00000100:00100000:2.0:1787380219.182023:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380219.182029:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ac9f67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5767:x1874203935508480:12345-0@lo:101: 00010000:00010000:2.0:1787380219.182040:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380219.182052:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc98dc3b/0x651a07d1188421b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188421b2 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.182072:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc98dc3b/0x651a07d1188421b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188421b2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.182082:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc98dc3b/0x651a07d1188421b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421b2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380219.182090:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc98dc3b, rc 0) 00000100:00100000:2.0:1787380219.182130:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ac9f67a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5767:x1874203935508480:12345-0@lo:101: Request processed in 101us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380219.182137:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380219.182217:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508480:0@lo:101: 00010000:00010000:0.0:1787380219.182229:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 000000002e80f322/0x651a07d1188421b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.182236:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 000000002e80f322/0x651a07d1188421b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380219.182288:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508608:0@lo:501: 00000100:00100000:0.0:1787380219.182315:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.182333:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d299f452 going to sleep for 11 seconds 00000100:00100000:2.0:1787380219.182868:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508608 00000100:00100000:2.0:1787380219.182879:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508608 00000100:00100000:2.0:1787380219.182900:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787380219.182904:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016d7a7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5767:x1874203935508608:12345-0@lo:501: 00000100:00100000:2.0:1787380219.183124:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016d7a7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5767:x1874203935508608:12345-0@lo:501: Request processed in 219us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380219.183132:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787380219.184114:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508608:0@lo:501: 00000100:00100000:0.0:1787380219.184165:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508736:0@lo:503: 00000100:00100000:0.0:1787380219.184216:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.184251:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d299f452 going to sleep for 11 seconds 00000100:00100000:2.0:1787380219.184314:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508736 00000100:00100000:2.0:1787380219.184319:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508736 00000100:00100000:2.0:1787380219.184425:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787380219.184432:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8e72832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5767:x1874203935508736:12345-0@lo:503: 00000100:00100000:2.0:1787380219.184734:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8e72832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5767:x1874203935508736:12345-0@lo:503: Request processed in 302us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380219.184742:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787380219.184897:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935508736:0@lo:503: 00000100:00100000:0.0:1787380219.185586:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5814:1874203935508864:0@lo:502: 00000100:00100000:0.0:1787380219.185637:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.185666:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set 000000006877ec1e going to sleep for 11 seconds 00000100:00100000:2.0:1787380219.185742:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508864 00000100:00100000:2.0:1787380219.185747:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508864 00000100:00100000:2.0:1787380219.185781:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787380219.185787:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cba40a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5814:x1874203935508864:12345-0@lo:502: 00000100:00100000:2.0:1787380219.185978:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cba40a5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5814:x1874203935508864:12345-0@lo:502: Request processed in 190us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380219.185984:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380219.186090:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5814:1874203935508864:0@lo:502: 00000020:01000004:0.0:1787380219.186137:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787380219.186160:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d1283d41) 00000020:00000080:0.0:1787380219.186183:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787380219.186499:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b429a487 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787380219.186503:0:5814:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b429a487 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787380219.186506:0:5814:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b429a487 4 00010000:00080000:0.0:1787380219.186530:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b23c268d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:0.0:1787380219.190634:0:5814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787380219.190748:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787380219.190787:0:5814:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380219.190799:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x651a07d1188421c7 00000100:00080000:0.0:1787380219.190809:0:5814:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380219.190814:0:5814:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b23c268d using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1787380219.190851:0:5814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c4533d49 x1874203935508992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380219.190878:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787380219.191165:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935508992:0@lo:38: 00000100:00100000:2.0:1787380219.191230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.191601:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935508992 00000100:00100000:0.0:1787380219.191608:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935508992 00000100:00100000:0.0:1787380219.191673:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380219.191680:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c1a80a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874203935508992:12345-0@lo:38: 00000100:00100000:0.0:1787380219.191742:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c1a80a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874203935508992:12345-0@lo:38: Request processed in 61us (512us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787380219.191749:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380219.191805:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380219.191819:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000b23c268d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787380219.191823:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787380219.191825:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c4533d49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935508992:0@lo:38: 00000100:00100000:0.0:1787380219.195673:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e0986d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5814:1874203935509120:0@lo:502: 00000100:00100000:0.0:1787380219.195748:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.195785:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935509120 00000100:00100000:0.0:1787380219.195792:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935509120 00000100:00100000:0.0:1787380219.195830:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380219.195838:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d74e501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5814:x1874203935509120:12345-0@lo:502: 00000100:00100000:0.0:1787380219.196048:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d74e501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5814:x1874203935509120:12345-0@lo:502: Request processed in 211us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380219.196056:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380219.196106:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set 000000006877ec1e going to sleep for 11 seconds 00000100:00100000:0.0:1787380219.196127:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e0986d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:5814:1874203935509120:0@lo:502: 00000040:00080000:0.0:1787380219.196164:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787380219.196482:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787380219.196500:0:5767:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787380219.196518:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: 000000002e80f322/0x651a07d1188421b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380219.196535:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: 000000002e80f322/0x651a07d1188421b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787380219.196576:0:5767:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787380219.196579:0:5767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380219.196580:0:5767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380219.196581:0:5767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380219.196582:0:5767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380219.196583:0:5767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380219.196584:0:5767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380219.196586:0:5767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380219.196587:0:5767:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380219.196588:0:5767:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380219.196589:0:5767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380219.196591:0:5767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380219.196594:0:5767:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787380219.196596:0:5767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380219.196598:0:5767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380219.196599:0:5767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380219.196600:0:5767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380219.196601:0:5767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380219.196602:0:5767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380219.196603:0:5767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380219.196604:0:5767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380219.196605:0:5767:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380219.196606:0:5767:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380219.196607:0:5767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380219.196608:0:5767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380219.196622:0:5767:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787380219.196630:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005cae8494 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935509248:0@lo:253: 00000100:00100000:1.0:1787380219.196663:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380219.196678:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set 0000000051bde304 going to sleep for 11 seconds 00000100:00100000:1.0:1787380219.196694:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935509248 00000100:00100000:1.0:1787380219.196698:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935509248 00000100:00100000:1.0:1787380219.196722:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787380219.196735:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054b879c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5767:x1874203935509248:12345-0@lo:253: 20000000:01000000:1.0:1787380219.196764:0:5781:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787380219.196777:0:5781:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787380219.225794:0:5781:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787380219.225814:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787380219.225877:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787380219.225882:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787380219.225900:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.225918:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842196 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.225936:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.225971:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842196 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.225985:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842196 expref: 12 pid: 5780 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380219.225998:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e0986d2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1874203935509376:0@lo:104: 00000100:00100000:0.0:1787380219.226055:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.226109:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000006877ec1e going to sleep for 11 seconds 00000100:00100000:1.0:1787380219.226546:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935509376 00000100:00100000:1.0:1787380219.226555:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935509376 00000100:00100000:1.0:1787380219.226598:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380219.226606:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca584e27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5802:x1874203935509376:12345-0@lo:104: 00010000:00010000:1.0:1787380219.226619:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380219.226669:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380219.226674:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca584e27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5802:x1874203935509376:12345-0@lo:104: Request processed in 70us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380219.226681:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380219.226800:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e0986d2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1874203935509376:0@lo:104: 00010000:00010000:0.0:1787380219.226817:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230119:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380219.230214:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230226:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e7abaff already unused, calling callback (000000002c53effc) 10000000:00010000:3.0:1787380219.230229:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230238:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380219.230243:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380219.230248:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380219.230290:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230297:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380219.230323:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230329:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d118842196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884219d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380219.230489:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2ed0ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935509504:0@lo:103: 00000100:00100000:1.0:1787380219.230550:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380219.230638:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380219.230640:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380219.230655:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380219.230674:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935509504 00000100:00100000:3.0:1787380219.230680:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935509504 00010000:00010000:3.0:1787380219.230705:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842196 expref: 13 pid: 5780 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380219.230737:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380219.230744:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006138b10e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:3300:x1874203935509504:12345-0@lo:103: 00010000:00010000:3.0:1787380219.230755:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380219.230759:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842196 expref: 13 pid: 5780 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230768:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842196 expref: 13 pid: 5780 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230780:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076b533dd/0x651a07d11884219d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842196 expref: 13 pid: 5780 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230792:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230798:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787380219.230810:0:5771:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004929178s 00010000:00010000:3.0:1787380219.230813:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230819:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230825:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230835:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230840:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000150ff651 already unused, calling callback (00000000cbd99c93) 00010000:00010000:3.0:1787380219.230843:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230849:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230858:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380219.230866:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380219.230896:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006138b10e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:3300:x1874203935509504:12345-0@lo:103: Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380219.230903:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380219.230931:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2ed0ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935509504:0@lo:103: 00010000:00010000:0.0:1787380219.231108:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.231116:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380219.231122:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000150ff651/0x651a07d1188421ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380219.231849:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054b879c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5767:x1874203935509248:12345-0@lo:253: Request processed in 35114us (35184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380219.231859:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787380219.231936:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005cae8494 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:5767:1874203935509248:0@lo:253: 10000000:01000000:3.0:1787380219.231946:0:5767:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787380219.231949:0:5767:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787380219.231951:0:5767:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787380219.231952:0:5767:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380219.231953:0:5767:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380219.231954:0:5767:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380219.231956:0:5767:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380219.231957:0:5767:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787380219.231958:0:5767:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787380219.231959:0:5767:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787380219.231960:0:5767:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787380219.231967:0:5767:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380219.231969:0:5767:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787380219.231979:0:5767:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787380219.239956:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787380219.240559:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787380219.240768:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787380219.240940:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787380219.241482:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787380219.241649:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787380219.242848:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787380219.243031:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787380219.243280:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787380219.243620:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787380219.243792:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787380219.243931:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787380219.285296:0:5767:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787380219.317531:0:5767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787380219.318010:0:5819:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787380219.318014:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787380219.318618:0:5820:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787380219.322653:0:5767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787380219.322847:0:5767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787380219.326894:0:5767:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787380219.328318:0:5767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787380219.328608:0:5767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380219.330054:0:5767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787380219.331937:0:5767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787380219.332010:0:5767:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787380219.334536:0:5767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787380219.334758:0:5767:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787380219.336362:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787380219.336505:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787380219.336635:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787380219.336773:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787380219.336932:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787380219.337097:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787380219.337715:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787380219.337848:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787380219.338014:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787380219.339506:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787380219.339722:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787380219.339885:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787380219.340044:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787380219.341537:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787380219.341724:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787380219.341882:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787380219.342237:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787380219.342413:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787380219.342557:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787380219.342680:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787380219.343284:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787380219.343460:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787380219.343608:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787380219.343727:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787380219.343868:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787380219.343985:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787380219.344144:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787380219.344278:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787380219.344442:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787380219.344591:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787380219.344741:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787380219.344874:0:5767:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787380219.345089:0:5767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787380219.385541:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380219.401135:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787380219.477866:0:5767:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787380219.477900:0:5767:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3081c7f988 00100000:10000000:3.0:1787380219.477908:0:5767:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787380219.479213:0:5767:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787380219.479228:0:5767:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787380219.479241:0:5767:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787380219.479265:0:5767:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787380219.522112:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787380219.522199:0:5820:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787380219.522204:0:5820:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787380220.415700:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380221.431557:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380222.455711:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380223.484239:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787380223.772765:0:6063:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787380224.247582:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787380224.247592:0:1362:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380224.247595:0:1362:0:(import.c:65:import_set_state_nolock()) 00000000b23c268d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380224.247609:0:1362:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b23c268d using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1787380224.247630:0:1362:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006c6ca878 x1874203935509760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380224.247688:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006c6ca878 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935509760:0@lo:38: 00000100:00100000:3.0:1787380224.247749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380224.247845:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935509760 00000100:00100000:3.0:1787380224.247852:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935509760 00000100:00100000:3.0:1787380224.247883:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380224.247890:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec2ba111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1874203935509760:12345-0@lo:38: 00010000:00080000:3.0:1787380224.247915:0:5788:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1787380224.247951:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x651a07d1188421d5 00000004:00100000:3.0:1787380224.247987:0:5788:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787380224.248152:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380224.248161:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e2ed0ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935509632:0@lo:400: 00000100:00100000:1.0:1787380224.248205:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380224.248238:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935509632 00000100:00100000:1.0:1787380224.248241:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935509632 00000100:00100000:1.0:1787380224.248273:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787380224.248279:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cf9d7e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:3302:x1874203935509632:12345-0@lo:400: 00000100:00100000:1.0:1787380224.248321:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cf9d7e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:3302:x1874203935509632:12345-0@lo:400: Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380224.248362:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787380224.248480:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e2ed0ce9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935509632:0@lo:400: 00000100:00080000:3.0:1787380224.252284:0:5788:0:(import.c:65:import_set_state_nolock()) 00000000c47e4e10 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380224.252407:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec2ba111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874203935509760:12345-0@lo:38: Request processed in 4516us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380224.252419:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787380224.252995:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006c6ca878 x1874203935509760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787380224.253015:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787380224.253023:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787380224.253029:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787380224.253041:0:3298:0:(import.c:65:import_set_state_nolock()) 00000000b23c268d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787380224.253049:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006c6ca878 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935509760:0@lo:38: 00010000:00010000:1.0:1787380224.508971:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380225.532676:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380226.551510:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787380226.807942:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787380226.807954:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d968b549800 from 3 10000000:01000000:0.0:1787380226.807961:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787380226.808029:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 0000000052c6acac/0x651a07d1188421dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380226.808046:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 0000000052c6acac/0x651a07d1188421dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380226.808059:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 0000000052c6acac/0x651a07d1188421dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380226.808092:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e0986d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935509888:0@lo:101: 00000100:00100000:0.0:1787380226.808198:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380226.808297:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000002163742f going to sleep for 11 seconds 00000100:00100000:1.0:1787380226.808471:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935509888 00000100:00100000:1.0:1787380226.808481:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935509888 00000100:00100000:1.0:1787380226.808554:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380226.808564:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ec5ecb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5783:x1874203935509888:12345-0@lo:101: 00010000:00010000:1.0:1787380226.808581:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380226.808598:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007dc4a94c/0x651a07d1188421e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188421dc expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380226.808625:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007dc4a94c/0x651a07d1188421e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188421dc expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380226.808642:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007dc4a94c/0x651a07d1188421e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421dc expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380226.808652:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007dc4a94c, rc 0) 00000100:00100000:1.0:1787380226.808709:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ec5ecb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935509888:12345-0@lo:101: Request processed in 146us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380226.808739:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380226.809047:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e0986d2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935509888:0@lo:101: 00010000:00010000:3.0:1787380226.809066:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 0000000052c6acac/0x651a07d1188421dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380226.809076:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 0000000052c6acac/0x651a07d1188421dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380226.809157:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d196ad6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510016:0@lo:256: 00000100:00100000:3.0:1787380226.809196:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380226.809232:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 0000000085188050 going to sleep for 11 seconds 00000100:00100000:1.0:1787380226.809393:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510016 00000100:00100000:1.0:1787380226.809399:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510016 00000100:00100000:1.0:1787380226.809438:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380226.809445:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c49037e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935510016:12345-0@lo:256: 20000000:01000000:1.0:1787380226.809463:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787380226.809484:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787380226.809488:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787380226.809585:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c49037e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935510016:12345-0@lo:256: Request processed in 140us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380226.809594:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380226.809684:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d196ad6d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510016:0@lo:256: 10000000:01000000:3.0:1787380226.809748:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787380226.809760:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: 0000000052c6acac/0x651a07d1188421dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380226.809768:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: 0000000052c6acac/0x651a07d1188421dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380227.576191:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380228.610079:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787380229.326213:0:6264:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdfc9882e0 00000020:00000080:0.0:1787380229.326230:0:6264:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787380229.326235:0:6264:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787380229.326242:0:6264:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfc98a570 20000000:00000080:0.0:1787380229.326248:0:6264:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d9689cf5c00 uarg=0000000000000000 20000000:01000000:0.0:1787380229.326284:0:6264:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787380229.326291:0:6264:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787380229.326295:0:6264:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787380229.327201:0:6264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787380229.327214:0:6264:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787380229.340274:0:6264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380229.340551:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787380229.340608:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787380229.340657:0:6264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787380229.340673:0:6264:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787380229.340690:0:6264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380229.340709:0:6264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421a4 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380229.340717:0:6264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380229.340752:0:6264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188421a4 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380229.340775:0:6264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188421a4 expref: 11 pid: 5781 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380229.340789:0:6264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098d06810 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6264:1874203935510144:0@lo:104: 00000100:00100000:1.0:1787380229.340847:0:6264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380229.340907:0:6264:0:(client.c:2702:ptlrpc_set_wait()) set 000000002bce8ff6 going to sleep for 11 seconds 00000100:00100000:3.0:1787380229.341073:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510144 00000100:00100000:3.0:1787380229.341080:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510144 00000100:00100000:3.0:1787380229.341143:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380229.341151:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077ad378a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:6264:x1874203935510144:12345-0@lo:104: 00010000:00010000:3.0:1787380229.341162:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.341224:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380229.341229:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077ad378a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:6264:x1874203935510144:12345-0@lo:104: Request processed in 80us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380229.341235:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787380229.341254:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380229.341258:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.341265:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e788dc8 already unused, calling callback (000000002c53effc) 10000000:00010000:3.0:1787380229.341268:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.341274:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380229.341279:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380229.341294:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380229.341319:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.341326:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380229.341368:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.341374:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: 000000002e788dc8/0x651a07d1188421a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421ab expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.341391:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380229.341393:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380229.341394:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380229.341411:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d196ad6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935510272:0@lo:103: 00000100:00100000:3.0:1787380229.341438:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380229.341475:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510272 00000100:00100000:0.0:1787380229.341479:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510272 00010000:00010000:0.0:1787380229.341502:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421a4 expref: 12 pid: 5781 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380229.341531:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380229.341536:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f58630fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:3302:x1874203935510272:12345-0@lo:103: 00000100:00100000:2.0:1787380229.341539:0:6264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098d06810 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6264:1874203935510144:0@lo:104: 00010000:00010000:0.0:1787380229.341545:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380229.341548:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421a4 expref: 12 pid: 5781 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380229.341555:0:6264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380229.341557:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188421a4 expref: 12 pid: 5781 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380229.341568:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ac12c8af/0x651a07d1188421ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188421a4 expref: 12 pid: 5781 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380229.344220:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380229.344239:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344388:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344397:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344402:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344409:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344414:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022c024d7 already unused, calling callback (00000000cbd99c93) 00010000:00010000:3.0:1787380229.344417:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344436:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344452:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380229.344464:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380229.344540:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f58630fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:3302:x1874203935510272:12345-0@lo:103: Request processed in 3001us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380229.344550:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787380229.344626:0:6264:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380229.344642:0:6264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380229.344647:0:6264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022c024d7/0x651a07d1188421ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380229.344725:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d196ad6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935510272:0@lo:103: 00000100:00100000:0.0:1787380229.375041:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006dd5e12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935510400:0@lo:400: 00000100:00100000:0.0:1787380229.375119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380229.375190:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510400 00000100:00100000:0.0:1787380229.375196:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510400 00000100:00100000:0.0:1787380229.375238:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380229.375245:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d25a036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935510400:12345-0@lo:400: 00000100:00100000:0.0:1787380229.375291:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d25a036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935510400:12345-0@lo:400: Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380229.375310:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787380229.375366:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006dd5e12f x1874203935510400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380229.375389:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006dd5e12f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935510400:0@lo:400: 00010000:00010000:0.0:1787380229.623804:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380230.648608:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380231.671529:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380232.375424:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380232.375432:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d968b549800 from 1 10000000:01000000:3.0:1787380232.375436:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380232.375487:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d1188421f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380232.375498:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d1188421f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380232.375507:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d1188421f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380232.375530:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510528:0@lo:101: 00000100:00100000:3.0:1787380232.375591:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380232.375649:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000003c240caf going to sleep for 11 seconds 00000100:00100000:2.0:1787380232.375818:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510528 00000100:00100000:2.0:1787380232.375826:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510528 00000100:00100000:2.0:1787380232.375880:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380232.375888:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d77573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:5783:x1874203935510528:12345-0@lo:101: 00010000:00010000:2.0:1787380232.375900:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380232.375912:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010651c4c/0x651a07d1188421f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188421f1 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380232.375932:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010651c4c/0x651a07d1188421f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188421f1 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380232.375941:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010651c4c/0x651a07d1188421f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421f1 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380232.375949:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010651c4c, rc 0) 00000100:00100000:2.0:1787380232.375994:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d77573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935510528:12345-0@lo:101: Request processed in 107us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380232.376000:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380232.376095:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510528:0@lo:101: 00010000:00010000:3.0:1787380232.376110:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d1188421f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380232.376132:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: 000000004e7abaff/0x651a07d1188421f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380232.376182:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510656:0@lo:501: 00000100:00100000:3.0:1787380232.376206:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380232.376232:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000003c240caf going to sleep for 11 seconds 00000100:00100000:1.0:1787380232.376293:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510656 00000100:00100000:1.0:1787380232.376298:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510656 00000100:00100000:1.0:1787380232.376330:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787380232.376354:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acb7160e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935510656:12345-0@lo:501: 00000100:00100000:1.0:1787380232.376572:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acb7160e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935510656:12345-0@lo:501: Request processed in 237us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380232.376579:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380232.376706:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510656:0@lo:501: 00000100:00100000:3.0:1787380232.376730:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510784:0@lo:503: 00000100:00100000:3.0:1787380232.376765:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380232.376790:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000003c240caf going to sleep for 11 seconds 00000100:00100000:2.0:1787380232.376905:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510784 00000100:00100000:2.0:1787380232.376909:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510784 00000100:00100000:2.0:1787380232.376938:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787380232.376944:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003653af2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935510784:12345-0@lo:503: 00000100:00100000:2.0:1787380232.377077:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003653af2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935510784:12345-0@lo:503: Request processed in 133us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380232.377094:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380232.377173:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935510784:0@lo:503: 00000100:00100000:3.0:1787380232.377679:0:6413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6413:1874203935510912:0@lo:502: 00000100:00100000:3.0:1787380232.377713:0:6413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380232.377739:0:6413:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b90b9da7 going to sleep for 11 seconds 00000100:00100000:2.0:1787380232.377785:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935510912 00000100:00100000:2.0:1787380232.377789:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935510912 00000100:00100000:2.0:1787380232.377817:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380232.377823:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc98ff91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6413:x1874203935510912:12345-0@lo:502: 00000100:00100000:2.0:1787380232.377960:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc98ff91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6413:x1874203935510912:12345-0@lo:502: Request processed in 136us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380232.377967:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380232.378091:0:6413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f00e8dbd pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6413:1874203935510912:0@lo:502: 00000020:01000000:1.0:1787380232.378114:0:6413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380232.378122:0:6413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380232.378124:0:6413:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787380232.378130:0:6413:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d968b549800 00000020:00000080:1.0:1787380232.378133:0:6413:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380232.378168:0:6413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6413:1874203935511040:0@lo:502: 00000100:00100000:1.0:1787380232.378199:0:6413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380232.378222:0:6413:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96959f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380232.378570:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511040 00000100:00100000:2.0:1787380232.378575:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511040 00000100:00100000:2.0:1787380232.378647:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380232.378655:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6413:x1874203935511040:12345-0@lo:502: 00000100:00100000:2.0:1787380232.378798:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6413:x1874203935511040:12345-0@lo:502: Request processed in 143us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380232.378804:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380232.380181:0:6413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6413:1874203935511040:0@lo:502: 00000020:01000000:1.0:1787380232.380219:0:6413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380232.380236:0:6413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380232.380238:0:6413:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787380232.380243:0:6413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787380232.381512:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787380232.381541:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380232.381551:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380232.381563:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380232.698393:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380233.724034:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380234.487842:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380234.487861:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935511296:0@lo:400: 00000100:00100000:1.0:1787380234.487920:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380234.487996:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511296 00000100:00100000:3.0:1787380234.488002:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511296 00000100:00100000:3.0:1787380234.488047:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380234.488055:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935511296:12345-0@lo:400: 00000100:00100000:3.0:1787380234.488112:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935511296:12345-0@lo:400: Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.488119:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787380234.488151:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d96bd43ce00 x1874203935511296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380234.488163:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935511296:0@lo:400: 00000100:00100000:0.0:1787380234.488606:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935511168:0@lo:400: 00000100:00100000:0.0:1787380234.488640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380234.488680:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511168 00000100:00100000:0.0:1787380234.488684:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511168 00000100:00100000:0.0:1787380234.488712:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380234.488718:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:3300:x1874203935511168:12345-0@lo:400: 00000100:00100000:0.0:1787380234.488752:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:3300:x1874203935511168:12345-0@lo:400: Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380234.488760:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380234.488794:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935511168:0@lo:400: 00010000:00010000:2.0:1787380234.746736:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787380235.662230:0:6574:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787380235.662234:0:6574:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787380235.662974:0:6574:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d96ba3b2800 00000020:01000004:0.0:1787380235.662990:0:6574:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787380235.663000:0:6574:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787380235.663012:0:6574:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d9695a5cd40) 00000020:00000080:0.0:1787380235.663027:0:6574:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787380235.692120:0:6574:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787380235.693024:0:6574:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787380235.725029:0:6574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787380235.730542:0:6574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787380235.730578:0:6574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787380235.730762:0:6574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787380235.730787:0:6574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787380235.731285:0:6574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787380235.731301:0:6574:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787380235.731314:0:6574:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x651a07d118842206 00000020:01000004:2.0:1787380235.731322:0:6574:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787380235.731369:0:6574:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787380235.731373:0:6574:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787380235.731378:0:6574:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787380235.731383:0:6574:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787380235.731393:0:6574:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d96be430000) 00000020:00000080:2.0:1787380235.731406:0:6574:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787380235.733271:0:6574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380235.733506:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787380235.733512:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787380235.734256:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380235.734263:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787380235.734893:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787380235.734900:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787380235.744058:0:6574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380235.744238:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787380235.744244:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787380235.747121:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787380235.747197:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:2.0:1787380235.768725:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380235.817494:0:6574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380235.817717:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787380235.817724:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787380235.821636:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380235.821650:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787380235.831441:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787380235.831457:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787380235.841236:0:6574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380235.841836:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787380235.841844:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787380235.842779:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787380235.842789:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787380235.925376:0:6574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380235.925560:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787380235.925567:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787380235.930425:0:6574:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787380235.930454:0:6574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787380235.931240:0:6574:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787380235.931263:0:6574:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787380235.931269:0:6574:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787380235.972130:0:6574:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787380235.972165:0:6574:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.114@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787380235.972169:0:6574:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787380235.972170:0:6574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787380235.972172:0:6574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380235.972173:0:6574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380235.972174:0:6574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380235.972175:0:6574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380235.972177:0:6574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380235.972178:0:6574:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787380235.972179:0:6574:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787380235.972181:0:6574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380235.972182:0:6574:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787380235.972186:0:6574:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787380235.972189:0:6574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787380235.972190:0:6574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787380235.972191:0:6574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380235.972192:0:6574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380235.972193:0:6574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380235.972194:0:6574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380235.972199:0:6574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380235.972200:0:6574:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787380235.972201:0:6574:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787380235.972202:0:6574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380235.972203:0:6574:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787380235.972234:0:6574:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787380235.972251:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935511424:0@lo:253: 00000100:00100000:3.0:1787380235.972315:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380235.972385:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787380235.972978:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511424 00000100:00100000:1.0:1787380235.972986:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511424 00000100:00100000:1.0:1787380235.973029:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787380235.973038:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935511424:12345-0@lo:253: 20000000:01000000:1.0:1787380235.973079:0:5779:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787380235.973083:0:5779:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787380235.973087:0:5779:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787380235.973091:0:5779:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787380235.974022:0:5779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380235.974246:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787380235.974260:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787380235.974297:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787380235.974304:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787380235.974331:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787380235.974431:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787380235.974760:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787380235.974779:0:5779:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.114@tcp 20000000:01000000:1.0:1787380235.974781:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.114@tcp (null) (null) (null) 00000040:00080000:1.0:1787380235.974813:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787380235.974821:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787380235.974864:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787380235.974873:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.114@tcp (null) (null) 00000040:00080000:1.0:1787380235.974903:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787380235.974911:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787380235.974938:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787380235.974997:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787380235.975649:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787380235.975667:0:5779:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.114@tcp 20000000:01000000:1.0:1787380235.975669:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.114@tcp (null) (null) (null) 00000040:00080000:1.0:1787380235.975701:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787380235.975708:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787380235.975735:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787380235.975742:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.114@tcp (null) (null) 00000040:00080000:1.0:1787380235.978794:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787380235.978818:0:5779:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787380235.978857:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787380235.978894:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787380235.978917:0:5779:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787380235.978920:0:5779:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787380235.978923:0:5779:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787380235.978934:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787380235.978937:0:5779:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787380235.978973:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787380235.978975:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787380235.980317:0:6589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787380235.980965:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787380235.981008:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787380235.981086:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787380235.981104:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787380235.981107:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380235.981785:0:6590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380235.981839:0:6590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380235.981898:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787380235.982150:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787380235.982188:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787380235.982276:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787380235.982290:0:5779:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787380235.982292:0:5779:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380235.982920:0:6591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380235.982970:0:6591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380235.983016:0:6591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787380235.984213:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787380235.984258:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787380235.984313:0:5779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787380235.984329:0:5779:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787380235.984332:0:5779:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787380235.984500:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787380235.984520:0:5779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.984536:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9680030400/0x651a07d11884212d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842126 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.984543:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163b400/0x651a07d118842149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842142 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.984550:0:5779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216d600/0x651a07d1188421b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421b2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.984556:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.984591:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216d600/0x651a07d1188421b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188421b2 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.984604:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96c216d600/0x651a07d1188421b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188421b2 expref: 12 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380235.984617:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1874203935511552:0@lo:104: 00000100:00100000:2.0:1787380235.984676:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380235.984781:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163b400/0x651a07d118842149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842142 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.984789:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d968163b400/0x651a07d118842149 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842142 expref: 12 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380235.984806:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1874203935511680:0@lo:104: 00000100:00100000:2.0:1787380235.984842:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380235.987674:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511552 00000100:00100000:1.0:1787380235.987686:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511552 00010000:00010000:2.0:1787380235.989569:0:5779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9680030400/0x651a07d11884212d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842126 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.989588:0:5779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9680030400/0x651a07d11884212d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842126 expref: 12 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380235.989602:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1874203935511808:0@lo:104: 00000100:00100000:2.0:1787380235.989659:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380235.989679:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ba13540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380235.991750:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511680 00000100:00100000:3.0:1787380235.991764:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511680 00000100:00100000:3.0:1787380235.991815:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511808 00000100:00100000:3.0:1787380235.991819:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511808 00000100:00100000:3.0:1787380235.991836:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380235.991844:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:5779:x1874203935511680:12345-0@lo:104: 00010000:00010000:3.0:1787380235.991860:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380235.991951:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380235.991957:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:5779:x1874203935511680:12345-0@lo:104: Request processed in 114us (7114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380235.991965:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380235.991981:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380235.991986:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:5779:x1874203935511808:12345-0@lo:104: 00010000:00010000:3.0:1787380235.991994:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380235.992133:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1874203935511680:0@lo:104: 00000100:00100000:2.0:1787380235.992143:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1874203935511808:0@lo:104: 00010000:00010000:3.0:1787380235.992211:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380235.992218:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:5779:x1874203935511808:12345-0@lo:104: Request processed in 232us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380235.992224:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380235.992281:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380235.992288:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5779:x1874203935511552:12345-0@lo:104: 00010000:00010000:3.0:1787380235.992297:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380235.992374:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5779:1874203935511552:0@lo:104: 00010000:00010000:2.0:1787380235.992400:0:5779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994658:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787380235.994670:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994680:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f2c00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380235.994685:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994693:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380235.994718:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380235.994723:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380235.994768:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994774:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380235.994795:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994802:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842149 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994815:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380235.994819:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994824:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163be00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380235.994827:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994833:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380235.994839:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380235.994844:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380235.994862:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994868:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380235.994882:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994888:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163be00/0x651a07d118842126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884212d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994897:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380235.994900:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994905:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9680031800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380235.994908:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994914:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380235.994920:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380235.994925:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380235.994934:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994940:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380235.994944:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994958:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9680031800/0x651a07d1188421b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.994975:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380235.994976:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380235.994978:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380235.995012:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935511936:0@lo:103: 00000100:00100000:1.0:1787380235.995080:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380235.995138:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935512064:0@lo:103: 00000100:00100000:1.0:1787380235.995161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380235.995177:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380235.995183:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935512192:0@lo:103: 00000100:00100000:1.0:1787380235.995200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380235.995233:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935511936 00000100:00100000:1.0:1787380235.995240:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935511936 00010000:00010000:1.0:1787380235.995265:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163b400/0x651a07d118842149 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842142 expref: 13 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380235.995283:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512064 00000100:00100000:1.0:1787380235.995285:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512064 00010000:00010000:1.0:1787380235.995294:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9680030400/0x651a07d11884212d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842126 expref: 14 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380235.995303:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512192 00000100:00100000:1.0:1787380235.995305:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512192 00010000:00010000:1.0:1787380235.995314:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216d600/0x651a07d1188421b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421b2 expref: 15 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380235.995326:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380235.995362:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:3302:x1874203935511936:12345-0@lo:103: 00010000:00010000:1.0:1787380235.995374:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380235.995379:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163b400/0x651a07d118842149 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842142 expref: 15 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995388:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163b400/0x651a07d118842149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842142 expref: 15 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995401:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b400/0x651a07d118842149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842142 expref: 15 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995413:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380235.995507:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:3302:x1874203935511936:12345-0@lo:103: Request processed in 168us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380235.995514:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380235.995530:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380235.995536:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:3299:x1874203935512064:12345-0@lo:103: 00010000:00010000:1.0:1787380235.995543:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380235.995547:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9680030400/0x651a07d11884212d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842126 expref: 13 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995555:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9680030400/0x651a07d11884212d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842126 expref: 13 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995564:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680030400/0x651a07d11884212d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842126 expref: 13 pid: 5780 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995573:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380235.995597:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:3299:x1874203935512064:12345-0@lo:103: Request processed in 62us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380235.995612:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380235.995623:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380235.995629:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:3299:x1874203935512192:12345-0@lo:103: 00010000:00010000:1.0:1787380235.995636:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380235.995640:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216d600/0x651a07d1188421b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421b2 expref: 11 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995649:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216d600/0x651a07d1188421b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188421b2 expref: 11 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995660:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216d600/0x651a07d1188421b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188421b2 expref: 11 pid: 5779 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995671:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995679:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995691:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995698:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995704:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995710:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995724:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380235.995728:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995736:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995749:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995759:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380235.995780:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:3299:x1874203935512192:12345-0@lo:103: Request processed in 151us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380235.995786:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380235.995823:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935512192:0@lo:103: 00000100:00100000:1.0:1787380235.995831:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935512064:0@lo:103: 00000100:00100000:1.0:1787380235.995857:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935511936:0@lo:103: 00010000:00010000:1.0:1787380235.995873:0:5779:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995880:0:5779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380235.995886:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216d800/0x651a07d118842214 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380235.995899:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787380235.997242:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380235.997564:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380235.997686:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787380235.997699:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5779:x1874203935511552:12345-0@lo:104: Request processed in 5407us (13018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380235.997711:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380236.091087:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:6574:x1874203935511424:12345-0@lo:253: Request processed in 118041us (118762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380236.091102:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380236.091612:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935511424:0@lo:253: 10000000:01000000:3.0:1787380236.091628:0:6574:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787380236.091631:0:6574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787380236.091632:0:6574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787380236.091634:0:6574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380236.091635:0:6574:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787380236.091636:0:6574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380236.091638:0:6574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380236.091639:0:6574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380236.091640:0:6574:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787380236.091642:0:6574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380236.091643:0:6574:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787380236.091666:0:6574:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d96ba3b2800 from lustre-OST0000 10000000:01000000:3.0:1787380236.091691:0:6574:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787380236.091694:0:6574:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787380236.091700:0:6574:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d9695a5b380 local copy 10000000:01000000:3.0:1787380236.091705:0:6574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787380236.091740:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.091751:0:6574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.091779:0:6574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380236.091795:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512320:0@lo:101: 00000100:00100000:3.0:1787380236.091833:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380236.091898:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380236.092005:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512320 00000100:00100000:0.0:1787380236.092013:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512320 00000100:00100000:0.0:1787380236.092067:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787380236.092077:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:6574:x1874203935512320:12345-0@lo:101: 00010000:00010000:0.0:1787380236.092089:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380236.092103:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9680030a00/0x651a07d118842222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884221b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.092125:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9680030a00/0x651a07d118842222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884221b expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.092135:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9680030a00/0x651a07d118842222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884221b expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.092151:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9680030a00, rc 0) 00000100:00100000:0.0:1787380236.092195:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:6574:x1874203935512320:12345-0@lo:101: Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380236.092202:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380236.092295:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512320:0@lo:101: 00010000:00010000:1.0:1787380236.092308:0:6574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.092317:0:6574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380236.092442:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512448:0@lo:501: 00000100:00100000:1.0:1787380236.092467:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.092488:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380236.092737:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512448 00000100:00100000:2.0:1787380236.092742:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512448 00000100:00100000:2.0:1787380236.092776:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380236.092783:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:6574:x1874203935512448:12345-0@lo:501: 00000100:00100000:2.0:1787380236.092978:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:6574:x1874203935512448:12345-0@lo:501: Request processed in 194us (508us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380236.092993:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787380236.093174:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512448:0@lo:501: 10000000:01000000:1.0:1787380236.093188:0:6574:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787380236.093216:0:6574:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787380236.093222:0:6574:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.093230:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.093236:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.093259:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380236.093359:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380236.093365:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.093383:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380236.093386:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.093395:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380236.093402:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380236.093407:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380236.093427:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.093432:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380236.093464:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.093472:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380236.093474:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380236.093476:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380236.093531:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380236.093544:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935512576:0@lo:103: 00000100:00100000:3.0:1787380236.093577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380236.093771:0:6574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d11884221b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x651a07d118842222 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380236.093803:0:6574:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d96ba3b2800 10000000:01000000:1.0:1787380236.093808:0:6574:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787380236.093819:0:6574:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d9695a5b380 10000000:01000000:1.0:1787380236.093822:0:6574:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787380236.093825:0:6574:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9d9695a5b380 from 1 10000000:01000000:1.0:1787380236.093828:0:6574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787380236.093846:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.093854:0:6574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.093862:0:6574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380236.093874:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512704:0@lo:101: 00000100:00100000:1.0:1787380236.093901:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.093921:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380236.093971:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512704 00000100:00100000:3.0:1787380236.093976:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512704 00000100:00100000:3.0:1787380236.094014:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787380236.094021:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:6574:x1874203935512704:12345-0@lo:101: 00010000:00010000:3.0:1787380236.094030:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380236.094041:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163a400/0x651a07d118842230 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842229 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.094057:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163a400/0x651a07d118842230 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842229 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.094079:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163a400/0x651a07d118842230 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842229 expref: 11 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.094086:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163a400, rc 0) 00000100:00100000:3.0:1787380236.094115:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935512704:12345-0@lo:101: Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.094122:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787380236.094246:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512576 00000100:00100000:0.0:1787380236.094250:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512576 00000100:00100000:0.0:1787380236.094387:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380236.094395:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:3302:x1874203935512576:12345-0@lo:103: 00010000:00010000:0.0:1787380236.094403:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380236.094415:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680030a00/0x651a07d118842222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d11884221b expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.094428:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380236.094465:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:3302:x1874203935512576:12345-0@lo:103: Request processed in 72us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380236.094471:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380236.094583:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935512576:0@lo:103: 00000100:00100000:1.0:1787380236.094720:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512704:0@lo:101: 00010000:00010000:1.0:1787380236.094732:0:6574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842230 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.094741:0:6574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842230 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380236.094755:0:6574:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787380236.094761:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842230 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.094768:0:6574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842230 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380236.094786:0:6574:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787380236.094789:0:6574:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380236.094794:0:6574:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787380236.094796:0:6574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787380236.094812:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.094819:0:6574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.094826:0:6574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380236.094837:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512832:0@lo:101: 00000100:00100000:1.0:1787380236.094863:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.094893:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380236.094983:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512832 00000100:00100000:3.0:1787380236.094988:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512832 00000100:00100000:3.0:1787380236.095021:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787380236.095028:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+10:6574:x1874203935512832:12345-0@lo:101: 00010000:00010000:3.0:1787380236.095036:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380236.095045:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842237 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.095070:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842237 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.095079:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842237 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.095085:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b200, rc 0) 00000100:00100000:3.0:1787380236.095120:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935512832:12345-0@lo:101: Request processed in 93us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.095126:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787380236.095226:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512832:0@lo:101: 00010000:00010000:1.0:1787380236.095237:0:6574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.095244:0:6574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380236.095513:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512960:0@lo:501: 00000100:00100000:1.0:1787380236.095537:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.095564:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380236.096090:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935512960 00000100:00100000:3.0:1787380236.096096:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935512960 00000100:00100000:3.0:1787380236.096132:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787380236.096139:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935512960:12345-0@lo:501: 00000100:00100000:3.0:1787380236.096408:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935512960:12345-0@lo:501: Request processed in 269us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.096415:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787380236.098782:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935512960:0@lo:501: 00000100:00100000:1.0:1787380236.098851:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513088:0@lo:503: 00000100:00100000:1.0:1787380236.098914:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.098960:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380236.099042:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513088 00000100:00100000:0.0:1787380236.099048:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513088 00000100:00100000:0.0:1787380236.099104:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787380236.099111:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935513088:12345-0@lo:503: 00000100:00100000:0.0:1787380236.099306:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935513088:12345-0@lo:503: Request processed in 193us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380236.099313:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787380236.099483:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513088:0@lo:503: 00000040:00080000:1.0:1787380236.099726:0:6574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380236.099792:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513216:0@lo:502: 00000100:00100000:1.0:1787380236.099825:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.099855:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380236.100405:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513216 00000100:00100000:2.0:1787380236.100411:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513216 00000100:00100000:2.0:1787380236.100443:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380236.100450:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935513216:12345-0@lo:502: 00000100:00100000:2.0:1787380236.100620:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935513216:12345-0@lo:502: Request processed in 169us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380236.100627:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787380236.100803:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513216:0@lo:502: 00000040:00080000:1.0:1787380236.101038:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787380236.101104:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787380236.101133:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787380236.101174:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787380236.101204:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787380236.101232:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787380236.101258:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513344:0@lo:502: 00000100:00100000:1.0:1787380236.101401:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.101424:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380236.101540:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513344 00000100:00100000:3.0:1787380236.101545:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513344 00000100:00100000:3.0:1787380236.101581:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380236.101589:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935513344:12345-0@lo:502: 00000100:00100000:3.0:1787380236.101732:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935513344:12345-0@lo:502: Request processed in 144us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.101739:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380236.101818:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513344:0@lo:502: 00000040:00080000:1.0:1787380236.101892:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787380236.101902:0:6574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787380236.103810:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380236.103821:0:6593:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787380236.103827:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380236.103830:0:6593:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787380236.103835:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380236.103849:0:6593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d96be4319c0) 00000020:00000080:2.0:1787380236.103869:0:6593:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787380236.103875:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787380236.103925:0:6593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96ba3b2800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787380236.103931:0:6593:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787380236.103939:0:6593:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x651a07d11884224c 00010000:00010000:3.0:1787380236.112944:0:6593:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787380236.113235:0:6593:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787380236.115924:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787380236.116222:0:6593:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787380236.123821:0:6593:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787380236.124332:0:6593:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787380236.126135:0:6593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787380236.126147:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380236.126153:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380236.126155:0:6593:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787380236.126158:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380236.126161:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380236.126163:0:6593:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380236.126166:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380236.126167:0:6593:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787380236.126217:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380236.126220:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380236.126222:0:6593:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787380236.126225:0:6593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787380236.126568:0:6574:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787380236.126591:0:6574:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787380236.126617:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.126628:0:6574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380236.126637:0:6574:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96ba3b2800 from 1 10000000:01000000:0.0:1787380236.126640:0:6574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380236.126680:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.126690:0:6574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.126700:0:6574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380236.126720:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513472:0@lo:101: 00000100:00100000:0.0:1787380236.126780:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380236.126830:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380236.126893:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513472 00000100:00100000:1.0:1787380236.126901:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513472 00000100:00100000:1.0:1787380236.126947:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787380236.126957:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:6574:x1874203935513472:12345-0@lo:101: 00010000:00010000:1.0:1787380236.126969:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380236.126987:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842253 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.127008:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842253 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.127019:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842253 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.127026:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96813f3c00, rc 0) 00000100:00100000:1.0:1787380236.127073:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513472:12345-0@lo:101: Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380236.127080:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787380236.127163:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513472:0@lo:101: 00010000:00010000:0.0:1787380236.127178:0:6574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.127187:0:6574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380236.127282:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513600:0@lo:501: 00000100:00100000:0.0:1787380236.127306:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380236.127328:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380236.127506:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513600 00000100:00100000:1.0:1787380236.127511:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513600 00000100:00100000:1.0:1787380236.127538:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787380236.127544:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513600:12345-0@lo:501: 00000100:00100000:1.0:1787380236.127739:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513600:12345-0@lo:501: Request processed in 194us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380236.127746:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787380236.134487:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513600:0@lo:501: 00000100:00100000:0.0:1787380236.134549:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513728:0@lo:503: 00000100:00100000:0.0:1787380236.134629:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380236.134671:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380236.134837:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513728 00000100:00100000:3.0:1787380236.134844:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513728 00000100:00100000:3.0:1787380236.134888:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787380236.134899:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513728:12345-0@lo:503: 00000100:00100000:3.0:1787380236.135249:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513728:12345-0@lo:503: Request processed in 352us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.135260:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787380236.135919:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513728:0@lo:503: 00000040:00080000:0.0:1787380236.136215:0:6574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787380236.136304:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513856:0@lo:502: 00000100:00100000:0.0:1787380236.136375:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380236.136410:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513856 00000100:00100000:0.0:1787380236.136416:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513856 00000100:00100000:0.0:1787380236.136450:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787380236.136459:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513856:12345-0@lo:502: 00000100:00100000:0.0:1787380236.136642:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513856:12345-0@lo:502: Request processed in 183us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380236.136650:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787380236.136688:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380236.136703:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513856:0@lo:502: 00000040:00080000:0.0:1787380236.136949:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787380236.136997:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787380236.137018:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513984:0@lo:502: 00000100:00100000:0.0:1787380236.137050:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380236.137083:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380236.137570:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935513984 00000100:00100000:1.0:1787380236.137577:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935513984 00000100:00100000:1.0:1787380236.137615:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380236.137624:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513984:12345-0@lo:502: 00000100:00100000:1.0:1787380236.137780:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935513984:12345-0@lo:502: Request processed in 158us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380236.137788:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787380236.139981:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935513984:0@lo:502: 00000040:00080000:0.0:1787380236.140907:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787380236.141808:0:6574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787380236.146094:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380236.146114:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380236.146117:0:6597:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787380236.146124:0:6597:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96ba3b2800 00000020:00000080:0.0:1787380236.146126:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380236.146147:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380236.146150:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380236.146151:0:6597:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787380236.146154:0:6597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787380236.146286:0:6574:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787380236.146309:0:6574:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380236.146329:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.146366:0:6574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380236.146420:0:6574:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787380236.146423:0:6574:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d96ba3b2800 10000000:01000000:1.0:1787380236.146425:0:6574:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d96ba3b2800 10000000:01000000:1.0:1787380236.146429:0:6574:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380236.146434:0:6574:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d96ba3b2800 from 1 10000000:01000000:1.0:1787380236.146437:0:6574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380236.146469:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.146478:0:6574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380236.146488:0:6574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380236.146507:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514112:0@lo:101: 00000100:00100000:1.0:1787380236.146559:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.146597:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380236.146832:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935514112 00000100:00100000:0.0:1787380236.146839:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935514112 00000100:00100000:0.0:1787380236.146869:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787380236.146877:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935514112:12345-0@lo:101: 00010000:00010000:0.0:1787380236.146889:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380236.146901:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842261 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.146919:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842261 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.146930:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842261 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.146938:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9680030400, rc 0) 00000100:00100000:0.0:1787380236.146982:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514112:12345-0@lo:101: Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380236.146988:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787380236.147097:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514112:0@lo:101: 00010000:00010000:3.0:1787380236.147116:0:6574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.147125:0:6574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380236.147201:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514240:0@lo:501: 00000100:00100000:3.0:1787380236.147224:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380236.147251:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787380236.147288:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935514240 00000100:00100000:0.0:1787380236.147292:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935514240 00000100:00100000:0.0:1787380236.147317:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787380236.147324:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514240:12345-0@lo:501: 00000100:00100000:0.0:1787380236.147659:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514240:12345-0@lo:501: Request processed in 335us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380236.147667:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787380236.147740:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514240:0@lo:501: 00000100:00100000:1.0:1787380236.147763:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514368:0@lo:503: 00000100:00100000:1.0:1787380236.147796:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.147822:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380236.147888:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935514368 00000100:00100000:3.0:1787380236.147892:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935514368 00000100:00100000:3.0:1787380236.147912:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787380236.147917:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514368:12345-0@lo:503: 00000100:00100000:3.0:1787380236.148251:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514368:12345-0@lo:503: Request processed in 332us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.148258:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787380236.148322:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514368:0@lo:503: 00000040:00080000:1.0:1787380236.148845:0:6574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380236.148897:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514496:0@lo:502: 00000100:00100000:1.0:1787380236.148932:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.148951:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380236.149032:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935514496 00000100:00100000:3.0:1787380236.149037:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935514496 00000100:00100000:3.0:1787380236.149071:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787380236.149078:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514496:12345-0@lo:502: 00000100:00100000:3.0:1787380236.149221:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514496:12345-0@lo:502: Request processed in 143us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.149227:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787380236.149266:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514496:0@lo:502: 00000040:00080000:3.0:1787380236.149824:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787380236.149874:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787380236.149911:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787380236.149979:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787380236.150016:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787380236.150081:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787380236.150120:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787380236.150158:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787380236.150207:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787380236.150243:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787380236.150279:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787380236.150327:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787380236.150942:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787380236.150979:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787380236.151034:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787380236.151086:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787380236.151123:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787380236.151191:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787380236.151233:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787380236.151284:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787380236.151483:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787380236.151527:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787380236.151563:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787380236.151615:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787380236.151654:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787380236.151691:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787380236.151742:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787380236.151780:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787380236.151826:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514624:0@lo:502: 00000100:00100000:3.0:1787380236.151894:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380236.151928:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380236.152166:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935514624 00000100:00100000:1.0:1787380236.152173:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935514624 00000100:00100000:1.0:1787380236.152223:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787380236.152232:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514624:12345-0@lo:502: 00000100:00100000:1.0:1787380236.155507:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935514624:12345-0@lo:502: Request processed in 3266us (3603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380236.155522:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380236.157417:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935514624:0@lo:502: 00000040:00080000:2.0:1787380236.157552:0:6574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787380236.157568:0:6574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787380236.158794:0:6598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787380236.158811:0:6598:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d96be434d40) 00000020:00000080:2.0:1787380236.158831:0:6598:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787380236.159042:0:6598:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96ba3b2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787380236.159046:0:6598:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d96ba3b2800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787380236.159054:0:6598:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d96ba3b2800 3 00010000:00080000:2.0:1787380236.159094:0:6598:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d95851fd000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.114@tcp at head 00010000:00010000:2.0:1787380236.160571:0:6598:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787380236.160680:0:6598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787380236.160710:0:6598:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787380236.160723:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x651a07d118842276 00000100:00080000:2.0:1787380236.160732:0:6598:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787380236.160737:0:6598:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d95851fd000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1787380236.160769:0:6598:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d96b56a3100 x1874203935514752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380236.160801:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874203935514752:0@lo:38: 00000100:00100000:2.0:1787380236.160861:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787380236.160913:0:6598:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787380236.160956:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935514880:0@lo:400: 00000100:00100000:2.0:1787380236.160979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380236.161318:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935514752 00000100:00100000:1.0:1787380236.161325:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935514752 00000100:00100000:1.0:1787380236.161388:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935514880 00000100:00100000:1.0:1787380236.161392:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935514880 00000100:00100000:1.0:1787380236.161425:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380236.161438:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935514880:12345-0@lo:400: 00000100:00100000:1.0:1787380236.161490:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935514880:12345-0@lo:400: Request processed in 55us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380236.161497:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380236.161510:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380236.161513:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1874203935514752:12345-0@lo:38: 00010000:00080000:1.0:1787380236.161531:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1787380236.161556:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x651a07d11884227d 00000004:00100000:1.0:1787380236.161569:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787380236.161595:0:5787:0:(import.c:65:import_set_state_nolock()) ffff9d96aaf14800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380236.161625:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874203935514752:12345-0@lo:38: Request processed in 110us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380236.161638:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787380236.162667:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d96b56a1500 x1874203935514880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380236.162684:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935514880:0@lo:400: 00010000:00080000:2.0:1787380236.162793:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d96b56a3100 x1874203935514752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380236.162802:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787380236.162808:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787380236.162815:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787380236.162820:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787380236.162822:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d95851fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787380236.162829:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874203935514752:0@lo:38: 00000040:00080000:2.0:1787380236.163015:0:6598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787380236.163181:0:6574:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787380236.163207:0:6574:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787380236.163258:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.163281:0:6574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787380236.163322:0:6574:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787380236.163324:0:6574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787380236.163326:0:6574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380236.163328:0:6574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380236.163329:0:6574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380236.163331:0:6574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380236.163332:0:6574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380236.163334:0:6574:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380236.163363:0:6574:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380236.163365:0:6574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380236.163367:0:6574:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787380236.163370:0:6574:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787380236.163373:0:6574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787380236.163374:0:6574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787380236.163375:0:6574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380236.163376:0:6574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380236.163377:0:6574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380236.163378:0:6574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380236.163379:0:6574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380236.163380:0:6574:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380236.163381:0:6574:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380236.163382:0:6574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380236.163383:0:6574:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787380236.163402:0:6574:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787380236.163414:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935515008:0@lo:253: 00000100:00100000:0.0:1787380236.163461:0:6574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380236.163492:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380236.163898:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515008 00000100:00100000:1.0:1787380236.163905:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515008 00000100:00100000:1.0:1787380236.163984:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787380236.163997:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6574:x1874203935515008:12345-0@lo:253: 20000000:01000000:1.0:1787380236.164021:0:5781:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787380236.164034:0:5781:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787380236.194123:0:5781:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787380236.194166:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787380236.194223:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787380236.194227:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787380236.194247:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.194290:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96813f3200/0x651a07d1188421e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421dc expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.194299:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.194332:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96813f3200/0x651a07d1188421e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188421dc expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380236.194371:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96813f3200/0x651a07d1188421e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188421dc expref: 13 pid: 5781 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380236.194386:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1874203935515136:0@lo:104: 00000100:00100000:0.0:1787380236.194439:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380236.194491:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d15900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380236.194579:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515136 00000100:00100000:2.0:1787380236.194586:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515136 00000100:00100000:2.0:1787380236.194628:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380236.194635:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5802:x1874203935515136:12345-0@lo:104: 00010000:00010000:2.0:1787380236.194647:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.194697:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787380236.194703:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5802:x1874203935515136:12345-0@lo:104: Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380236.194709:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787380236.194726:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380236.194731:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.194738:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9680030000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1787380236.194742:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.194751:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380236.194758:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380236.194764:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787380236.194785:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.194802:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380236.194818:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.194824:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d1188421dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421e3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.194840:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380236.194842:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380236.194843:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380236.194923:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1874203935515136:0@lo:104: 00010000:00010000:0.0:1787380236.194939:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380236.195122:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935515264:0@lo:103: 00000100:00100000:2.0:1787380236.195152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380236.195214:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515264 00000100:00100000:3.0:1787380236.195218:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515264 00010000:00010000:3.0:1787380236.195244:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96813f3200/0x651a07d1188421e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421dc expref: 14 pid: 5781 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380236.195276:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380236.195282:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:3299:x1874203935515264:12345-0@lo:103: 00010000:00010000:3.0:1787380236.195292:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380236.195297:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96813f3200/0x651a07d1188421e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421dc expref: 14 pid: 5781 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195307:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96813f3200/0x651a07d1188421e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188421dc expref: 14 pid: 5781 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195320:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96813f3200/0x651a07d1188421e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188421dc expref: 14 pid: 5781 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195333:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195368:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787380236.195380:0:5773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004929178s 00010000:00010000:3.0:1787380236.195384:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195391:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195398:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195404:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195414:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9680031800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380236.195418:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195425:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195437:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380236.195445:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380236.195473:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:3299:x1874203935515264:12345-0@lo:103: Request processed in 191us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.195479:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380236.195651:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935515264:0@lo:103: 00010000:00010000:2.0:1787380236.195667:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.195674:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380236.195679:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680031800/0x651a07d118842284 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380236.203480:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:6574:x1874203935515008:12345-0@lo:253: Request processed in 39480us (40010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380236.203494:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380236.203572:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:6574:1874203935515008:0@lo:253: 10000000:01000000:0.0:1787380236.203586:0:6574:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787380236.203589:0:6574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787380236.203591:0:6574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787380236.203593:0:6574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380236.203594:0:6574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380236.203595:0:6574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380236.203597:0:6574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380236.203598:0:6574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380236.203600:0:6574:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380236.203601:0:6574:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380236.203615:0:6574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380236.203617:0:6574:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787380236.203633:0:6574:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787380236.206970:0:6574:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380236.207235:0:6574:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787380236.207612:0:6574:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380236.207818:0:6574:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787380236.208005:0:6574:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380236.208848:0:6574:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787380236.209915:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787380236.395939:0:6574:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787380236.395945:0:6574:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787380236.395977:0:6574:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787380236.396033:0:6574:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787380236.396046:0:6574:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787380236.396085:0:6574:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787380236.791939:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380237.817088:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787380237.943480:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787380237.943487:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d968b549800 from 21 10000000:01000000:2.0:1787380237.943492:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380237.943535:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.943564:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.943575:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380237.943598:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935515392:0@lo:101: 00000100:00100000:2.0:1787380237.943656:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380237.943720:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9586d0b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380237.943775:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515392 00000100:00100000:0.0:1787380237.943782:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515392 00000100:00100000:0.0:1787380237.943833:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787380237.943842:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935515392:12345-0@lo:101: 00010000:00010000:0.0:1787380237.943854:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380237.943866:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884228b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380237.943888:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884228b expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380237.943897:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884228b expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380237.943906:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9680030000, rc 0) 00000100:00100000:0.0:1787380237.943962:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935515392:12345-0@lo:101: Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380237.943968:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787380237.944013:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935515392:0@lo:101: 00010000:00010000:3.0:1787380237.944027:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380237.944035:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380237.944117:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935515520:0@lo:501: 00000100:00100000:3.0:1787380237.944143:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380237.944308:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380237.944495:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515520 00000100:00100000:1.0:1787380237.944500:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515520 00000100:00100000:1.0:1787380237.944523:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787380237.944530:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935515520:12345-0@lo:501: 00000100:00100000:1.0:1787380237.944884:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935515520:12345-0@lo:501: Request processed in 354us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380237.944891:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787380237.945581:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935515520:0@lo:501: 00000100:00100000:3.0:1787380237.945622:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935515648:0@lo:503: 00000100:00100000:3.0:1787380237.945669:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380237.945704:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380237.946063:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515648 00000100:00100000:2.0:1787380237.946069:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515648 00000100:00100000:2.0:1787380237.946141:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787380237.946150:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935515648:12345-0@lo:503: 00000100:00100000:2.0:1787380237.946492:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935515648:12345-0@lo:503: Request processed in 343us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380237.946500:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787380237.946880:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935515648:0@lo:503: 00000100:00100000:0.0:1787380237.955065:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6674:1874203935515776:0@lo:502: 00000100:00100000:0.0:1787380237.955146:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380237.955199:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba36e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380237.955294:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515776 00000100:00100000:3.0:1787380237.955301:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515776 00000100:00100000:3.0:1787380237.955415:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787380237.955425:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6674:x1874203935515776:12345-0@lo:502: 00000100:00100000:3.0:1787380237.955965:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6674:x1874203935515776:12345-0@lo:502: Request processed in 540us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380237.955975:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787380237.956102:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6674:1874203935515776:0@lo:502: 00000100:00100000:0.0:1787380237.956150:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6674:1874203935515904:0@lo:502: 00000100:00100000:0.0:1787380237.956182:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380237.956212:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba36e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787380237.956899:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935515904 00000100:00100000:2.0:1787380237.956907:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935515904 00000100:00100000:2.0:1787380237.956944:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380237.956952:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6674:x1874203935515904:12345-0@lo:502: 00000100:00100000:2.0:1787380237.957147:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:6674:x1874203935515904:12345-0@lo:502: Request processed in 195us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380237.957155:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787380237.957449:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6674:1874203935515904:0@lo:502: 00000040:00080000:3.0:1787380237.957476:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787380237.966439:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787380237.966469:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380237.966482:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.966501:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380237.966510:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787380237.966513:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d968b549800 from 4 10000000:01000000:2.0:1787380237.966516:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380237.966552:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.966560:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.966570:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380237.966603:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516032:0@lo:101: 00000100:00100000:2.0:1787380237.966673:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380237.966730:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9586d0b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380237.966752:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516032 00000100:00100000:1.0:1787380237.966769:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516032 00000100:00100000:1.0:1787380237.966815:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787380237.966824:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935516032:12345-0@lo:101: 00010000:00010000:1.0:1787380237.966837:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380237.966851:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842299 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380237.966871:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842299 expref: 14 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380237.966881:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842299 expref: 14 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380237.966899:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96813f2000, rc 0) 00000100:00100000:1.0:1787380237.966937:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935516032:12345-0@lo:101: Request processed in 113us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380237.966944:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787380237.966953:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516032:0@lo:101: 00010000:00010000:2.0:1787380237.966964:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.966973:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380237.967021:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516160:0@lo:256: 00000100:00100000:2.0:1787380237.967059:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380237.967090:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9586d0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380237.967104:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516160 00000100:00100000:2.0:1787380237.967108:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516160 00000100:00100000:2.0:1787380237.967134:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787380237.967140:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935516160:12345-0@lo:256: 20000000:01000000:2.0:1787380237.967152:0:5781:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787380237.967167:0:5781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787380237.967170:0:5781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787380237.967237:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935516160:12345-0@lo:256: Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380237.967244:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787380237.967273:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516160:0@lo:256: 10000000:01000000:2.0:1787380237.967308:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380237.967314:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.967321:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380237.967328:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787380237.967886:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787380237.967891:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787380237.967914:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.967922:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.967931:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380237.967955:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516288:0@lo:101: 00000100:00100000:2.0:1787380237.967985:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380237.968019:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9586d0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380237.968033:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516288 00000100:00100000:2.0:1787380237.968037:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516288 00000100:00100000:2.0:1787380237.968080:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787380237.968160:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935516288:12345-0@lo:101: 00010000:00010000:2.0:1787380237.968171:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380237.968183:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188422a7 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.968199:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188422a7 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.968220:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188422a7 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.968228:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d000, rc 0) 00000100:00100000:2.0:1787380237.968258:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935516288:12345-0@lo:101: Request processed in 171us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380237.981324:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787380237.982311:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516288:0@lo:101: 00010000:00010000:2.0:1787380237.984644:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380237.984671:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380237.985431:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516416:0@lo:501: 00000100:00100000:2.0:1787380237.985491:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380237.985537:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9586d0b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380237.988770:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516416 00000100:00100000:3.0:1787380237.988785:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516416 00000100:00100000:3.0:1787380237.988839:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787380237.988850:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935516416:12345-0@lo:501: 00000100:00100000:3.0:1787380237.989127:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935516416:12345-0@lo:501: Request processed in 278us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380237.989135:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787380237.989991:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516416:0@lo:501: 00000100:00100000:2.0:1787380237.990044:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516544:0@lo:503: 00000100:00100000:2.0:1787380237.990108:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380237.990142:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9586d0b600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380237.991001:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516544 00000100:00100000:2.0:1787380237.991010:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516544 00000100:00100000:2.0:1787380237.991063:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787380237.991071:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935516544:12345-0@lo:503: 00000100:00100000:0.0:1787380237.994110:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935516544:12345-0@lo:503: Request processed in 3032us (3994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380237.994123:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787380237.994308:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935516544:0@lo:503: 00000100:00100000:2.0:1787380237.994927:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6677:1874203935516672:0@lo:502: 00000100:00100000:2.0:1787380237.994977:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380237.995018:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9586d0b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380237.995084:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516672 00000100:00100000:3.0:1787380237.995090:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516672 00000100:00100000:3.0:1787380237.995130:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787380237.995139:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:6677:x1874203935516672:12345-0@lo:502: 00000100:00100000:3.0:1787380237.995552:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:6677:x1874203935516672:12345-0@lo:502: Request processed in 413us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380237.995560:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787380237.995886:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6677:1874203935516672:0@lo:502: 00000020:01000000:2.0:1787380237.995914:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380237.995921:0:6677:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787380237.995928:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380237.995930:0:6677:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787380237.995936:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787380237.995940:0:6677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:2.0:1787380237.995959:0:6677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787380237.995962:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380237.995991:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d96877319c0) 00000020:00000080:2.0:1787380237.996010:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787380237.996016:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787380237.996099:0:6677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787380237.996104:0:6677:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787380237.996111:0:6677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d1188422bc 00010000:00080000:2.0:1787380237.996137:0:6677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d96b7e45000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:0.0:1787380238.009010:0:6677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787380238.082243:0:6677:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787380238.082269:0:6677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787380238.082831:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380238.082992:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380238.083039:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787380238.083108:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787380238.086417:0:6680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380238.086424:0:6680:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787380238.101228:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380238.101243:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787380238.101295:0:6677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787380238.101316:0:6677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d1188422c3 00000100:00080000:3.0:1787380238.101326:0:6677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380238.101363:0:6677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d96b7e45000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1787380238.101718:0:6677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d96b5f34380 x1874203935516800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380238.101752:0:6677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787380238.101818:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380238.101823:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380238.101824:0:6677:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787380238.101828:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380238.101831:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380238.101833:0:6677:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380238.101836:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380238.101837:0:6677:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787380238.101864:0:6677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6677:1874203935516928:0@lo:502: 00000100:00100000:3.0:1787380238.101937:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380238.101975:0:6677:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380238.102004:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516928 00000100:00100000:3.0:1787380238.102009:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516928 00000100:00100000:3.0:1787380238.102046:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787380238.102067:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:6677:x1874203935516928:12345-0@lo:502: 00000100:00100000:3.0:1787380238.102669:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:6677:x1874203935516928:12345-0@lo:502: Request processed in 601us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380238.102692:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787380238.102749:0:6677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:6677:1874203935516928:0@lo:502: 00000020:01000000:3.0:1787380238.102775:0:6677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380238.102781:0:6677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380238.102782:0:6677:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787380238.102786:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787380238.102892:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787380238.102907:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787380238.102916:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.102927:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380238.102936:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787380238.102939:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d9695a5b380 from 1 10000000:01000000:3.0:1787380238.102943:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787380238.102967:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.102975:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.102983:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380238.102997:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935517056:0@lo:101: 00000100:00100000:3.0:1787380238.103026:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380238.103043:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380238.103077:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517056 00000100:00100000:3.0:1787380238.103082:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517056 00000100:00100000:3.0:1787380238.103106:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787380238.103112:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935517056:12345-0@lo:101: 00010000:00010000:3.0:1787380238.103122:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380238.103134:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188422ca expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.103154:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188422ca expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.103165:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188422ca expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.103174:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163a800, rc 0) 00000100:00100000:3.0:1787380238.103217:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935517056:12345-0@lo:101: Request processed in 103us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380238.103224:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787380238.103579:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935516800:0@lo:8: 00000100:00100000:2.0:1787380238.103619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380238.103845:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935516800 00000100:00100000:2.0:1787380238.103849:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935516800 00000100:00100000:2.0:1787380238.103870:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380238.103876:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874203935516800:12345-0@lo:8: 00010000:00080000:2.0:1787380238.103896:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1787380238.103921:0:6576:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d1188422d8 00002000:00100000:2.0:1787380238.103953:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d96b7e40000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787380238.103958:0:6576:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787380238.103962:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787380238.104086:0:6576:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787380238.104235:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787380238.108477:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9d96b7e41000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380238.108578:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874203935516800:12345-0@lo:8: Request processed in 4697us (4955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.108590:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380238.108634:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380238.108647:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935517184:0@lo:400: 00000100:00100000:3.0:1787380238.108795:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935517056:0@lo:101: 00010000:00010000:3.0:1787380238.108818:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.108830:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380238.108891:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935517440:0@lo:501: 00000100:00100000:3.0:1787380238.108924:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380238.108944:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380238.108964:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517440 00000100:00100000:3.0:1787380238.108975:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517440 00000100:00100000:3.0:1787380238.109007:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787380238.109015:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935517440:12345-0@lo:501: 00000100:00100000:3.0:1787380238.109237:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935517440:12345-0@lo:501: Request processed in 222us (311us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380238.109245:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380238.109505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380238.109545:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935517312:0@lo:400: 00000100:00100000:2.0:1787380238.109568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787380238.109621:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5f34380 x1874203935516800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.109631:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787380238.109637:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787380238.109644:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787380238.109649:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787380238.109652:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96b7e45000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787380238.109674:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787380238.109806:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935516800:0@lo:8: 00000100:00100000:2.0:1787380238.109841:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517184 00000004:00080000:0.0:1787380238.109843:0:6680:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787380238.109845:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517184 00000100:00100000:2.0:1787380238.109881:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517312 00000100:00100000:2.0:1787380238.109884:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517312 00000100:00100000:2.0:1787380238.109915:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380238.109922:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935517184:12345-0@lo:400: 00000100:00100000:2.0:1787380238.109967:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935517184:12345-0@lo:400: Request processed in 44us (460us total) trans 0 rc 0/0 00000004:00080000:0.0:1787380238.109967:0:6680:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 188421627089ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787380238.109978:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380238.109992:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380238.109998:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935517312:12345-0@lo:400: 00000100:00100000:2.0:1787380238.110034:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935517312:12345-0@lo:400: Request processed in 36us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.110040:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787380238.110078:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b56a3480 x1874203935517312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380238.110091:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935517312:0@lo:400: 00010000:00080000:2.0:1787380238.110094:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b56a0a80 x1874203935517184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.110106:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935517184:0@lo:400: 00000100:00080000:1.0:1787380238.110365:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380238.114230:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935517440:0@lo:501: 10000000:01000000:3.0:1787380238.114945:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787380238.114958:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380238.114970:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380238.169325:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787380238.282776:0:6681:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787380238.282807:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935517696:0@lo:7: 00000100:00100000:1.0:1787380238.282872:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.282912:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380238.282959:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935517568:0@lo:13: 00000100:00100000:2.0:1787380238.282988:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380238.283082:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517696 00000100:00100000:3.0:1787380238.283090:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517696 00000100:00100000:3.0:1787380238.283145:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380238.283155:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6681:x1874203935517696:12345-0@lo:7: 00000100:00100000:1.0:1787380238.284623:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517568 00000100:00100000:1.0:1787380238.284633:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517568 00000100:00100000:1.0:1787380238.284678:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380238.284687:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874203935517568:12345-0@lo:13: 00002000:00000024:1.0:1787380238.284714:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787380238.284771:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874203935517568:12345-0@lo:13: Request processed in 84us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380238.284778:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787380238.285480:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787380238.285614:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43e680 x1874203935517568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.285636:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935517568:0@lo:13: 00002000:00080000:2.0:1787380238.291136:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787380238.291144:0:6578:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787380238.291277:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6681:x1874203935517696:12345-0@lo:7: Request processed in 8121us (8401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.291288:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787380238.291645:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43ea00 x1874203935517696/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787380254 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380238.291660:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935517696:0@lo:7: 00000004:00080000:1.0:1787380238.291674:0:6681:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787380238.291710:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935517824:0@lo:5: 00000100:00100000:1.0:1787380238.291743:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.291812:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380238.291853:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517824 00000100:00100000:2.0:1787380238.291860:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517824 00000100:00100000:2.0:1787380238.291944:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380238.291953:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6681:x1874203935517824:12345-0@lo:5: 00002000:00080000:2.0:1787380238.291975:0:6577:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787380238.291978:0:6577:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787380238.292209:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6681:x1874203935517824:12345-0@lo:5: Request processed in 256us (465us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787380238.292217:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787380238.292451:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43ea00 x1874203935517824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380254 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380238.292464:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935517824:0@lo:5: 00000004:00080000:1.0:1787380238.292472:0:6681:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787380238.292577:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935517952:0@lo:700: 00000100:00100000:1.0:1787380238.292605:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.292671:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380238.292750:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935517952 00000100:00100000:0.0:1787380238.292755:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935517952 00000100:00100000:0.0:1787380238.292804:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380238.292812:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6681:x1874203935517952:12345-0@lo:700: 00000100:00100000:0.0:1787380238.292841:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6585:1874203935518080:0@lo:700: 00000100:00100000:0.0:1787380238.292870:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.292974:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96919736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380238.293017:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518080 00000100:00100000:2.0:1787380238.293021:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518080 00000100:00100000:2.0:1787380238.293112:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380238.293120:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6585:x1874203935518080:12345-0@lo:700: 40000000:02000000:2.0:1787380238.326802:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787380238.344810:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6585:x1874203935518080:12345-0@lo:700: Request processed in 51682us (51929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.344841:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787380238.345109:0:6585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9688e79c00 x1874203935518080/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787380254 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.345123:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6585:1874203935518080:0@lo:700: 40000000:02000000:2.0:1787380238.345134:0:6585:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787380238.500083:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6681:x1874203935517952:12345-0@lo:700: Request processed in 207264us (207468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380238.500101:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:0.0:1787380238.500393:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787380238.500407:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1787380238.500655:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43df80 x1874203935517952/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787380254 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380238.500671:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935517952:0@lo:700: 00000004:02000040:1.0:1787380238.552103:0:6681:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787380238.560729:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935518208:0@lo:5: 00000100:00100000:1.0:1787380238.560796:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.560846:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380238.560968:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518208 00000100:00100000:2.0:1787380238.560976:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518208 00000100:00100000:2.0:1787380238.561030:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380238.561039:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6681:x1874203935518208:12345-0@lo:5: 00002000:00080000:2.0:1787380238.571159:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787380238.571184:0:6578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787380238.594901:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6681:x1874203935518208:12345-0@lo:5: Request processed in 33856us (34098us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787380238.594918:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787380238.598439:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43df80 x1874203935518208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380254 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.598454:0:6681:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787380238.598471:0:6681:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d96bd43df80 x1874203935518208/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380254 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.598481:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6681:1874203935518208:0@lo:5: 00000004:00080000:2.0:1787380238.598505:0:6681:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787380238.839570:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380239.870825:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380240.888903:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380241.912058:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380242.935471:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380243.197548:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380243.197569:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935518592:0@lo:400: 00000100:00100000:2.0:1787380243.197668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380243.197726:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518592 00000100:00100000:2.0:1787380243.197732:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518592 00000100:00100000:2.0:1787380243.197809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380243.197825:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935518592:12345-0@lo:400: 00000100:00100000:2.0:1787380243.197885:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935518592:12345-0@lo:400: Request processed in 60us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380243.197892:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787380243.197929:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b56a1c00 x1874203935518592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380243.197941:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935518592:0@lo:400: 00000100:00100000:2.0:1787380243.197973:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935518720:0@lo:400: 00000100:00100000:2.0:1787380243.197997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380243.198045:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518720 00000100:00100000:2.0:1787380243.198049:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518720 00000100:00100000:2.0:1787380243.198076:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380243.198082:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874203935518720:12345-0@lo:400: 00000100:00100000:2.0:1787380243.198114:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874203935518720:12345-0@lo:400: Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380243.198120:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787380243.198144:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b56a1c00 x1874203935518720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380243.198153:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935518720:0@lo:400: 00000100:00100000:3.0:1787380243.198550:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935518336:0@lo:400: 00000100:00100000:3.0:1787380243.198587:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380243.198617:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380243.198622:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935518464:0@lo:400: 00000100:00100000:3.0:1787380243.198644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380243.198674:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518464 00000100:00100000:3.0:1787380243.198687:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518464 00000100:00100000:3.0:1787380243.198717:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380243.198722:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935518464:12345-0@lo:400: 00000100:00100000:3.0:1787380243.198758:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935518464:12345-0@lo:400: Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380243.198765:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787380243.198860:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b56a0380 x1874203935518464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380243.198870:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935518464:0@lo:400: 00000100:00100000:2.0:1787380243.199292:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518336 00000100:00100000:2.0:1787380243.199297:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518336 00000100:00100000:2.0:1787380243.199324:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380243.199331:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3299:x1874203935518336:12345-0@lo:400: 00000100:00100000:2.0:1787380243.199397:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3299:x1874203935518336:12345-0@lo:400: Request processed in 65us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380243.199411:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787380243.199896:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935518336:0@lo:400: 00000100:00080000:1.0:1787380243.200139:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380243.200144:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380243.707468:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935518848:0@lo:13: 00000100:00100000:2.0:1787380243.707536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380243.707608:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518848 00000100:00100000:2.0:1787380243.707614:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518848 00000100:00100000:2.0:1787380243.707658:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380243.707665:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935518848:12345-0@lo:13: 00002000:00000024:2.0:1787380243.707696:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380243.707736:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935518848:12345-0@lo:13: Request processed in 70us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380243.707742:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787380243.707777:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b56a1c00 x1874203935518848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380243.707793:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935518848:0@lo:13: 00000001:00080000:0.0:1787380243.852450:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787380243.969263:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380244.053855:0:6948:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787380244.988671:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380246.007759:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380247.031501:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380248.060543:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380248.313587:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935518976:0@lo:400: 00000100:00100000:2.0:1787380248.313656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380248.313710:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380248.313716:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935519360:0@lo:400: 00000100:00100000:2.0:1787380248.313742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380248.313772:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935519232:0@lo:400: 00000100:00100000:1.0:1787380248.313790:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935518976 00000100:00100000:1.0:1787380248.313797:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935518976 00000100:00100000:2.0:1787380248.313798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380248.313814:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380248.313819:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935519104:0@lo:400: 00000100:00100000:1.0:1787380248.313839:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787380248.313847:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3300:x1874203935518976:12345-0@lo:400: 00000100:00100000:2.0:1787380248.313858:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380248.313893:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3300:x1874203935518976:12345-0@lo:400: Request processed in 47us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380248.313910:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787380248.316925:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935518976:0@lo:400: 00000100:00100000:3.0:1787380248.316981:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935519360 00000100:00100000:3.0:1787380248.316988:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935519360 00000100:00100000:3.0:1787380248.317054:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380248.317064:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935519360:12345-0@lo:400: 00000100:00100000:3.0:1787380248.317141:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935519360:12345-0@lo:400: Request processed in 78us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380248.317148:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787380248.317168:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380248.317198:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43c000 x1874203935519360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380248.317209:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787380248.317220:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935519360:0@lo:400: 00000100:00100000:0.0:1787380248.326844:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935519232 00000100:00100000:0.0:1787380248.326858:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935519232 00000100:00100000:0.0:1787380248.326939:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935519104 00000100:00100000:0.0:1787380248.326943:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935519104 00000100:00100000:0.0:1787380248.326966:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380248.326976:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935519232:12345-0@lo:400: 00000100:00100000:0.0:1787380248.327076:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935519232:12345-0@lo:400: Request processed in 102us (13276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380248.327084:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380248.327102:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380248.327116:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935519104:12345-0@lo:400: 00000100:00100000:0.0:1787380248.327147:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935519104:12345-0@lo:400: Request processed in 32us (13287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380248.327153:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787380248.327270:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787380248.327305:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43c700 x1874203935519104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380248.327320:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935519104:0@lo:400: 00010000:00080000:2.0:1787380248.327333:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43f100 x1874203935519232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380248.327486:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935519232:0@lo:400: 00000100:00100000:0.0:1787380248.836123:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380248.836147:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935519488:0@lo:13: 00000100:00100000:0.0:1787380248.836215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380248.836276:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935519488 00000100:00100000:0.0:1787380248.836283:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935519488 00000100:00100000:0.0:1787380248.836324:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380248.836332:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935519488:12345-0@lo:13: 00002000:00000024:0.0:1787380248.836383:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380248.836748:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935519488:12345-0@lo:13: Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380248.836758:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787380248.836810:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9688e7b800 x1874203935519488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380248.836826:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935519488:0@lo:13: 00010000:00010000:1.0:1787380249.083916:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380250.104539:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380251.127727:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380252.153702:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380253.175445:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380253.435027:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935519744:0@lo:400: 00000100:00100000:3.0:1787380253.435101:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380253.435147:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380253.435153:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935519616:0@lo:400: 00000100:00100000:3.0:1787380253.435179:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380253.435207:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935519872:0@lo:400: 00000100:00100000:3.0:1787380253.435232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380253.435249:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380253.435254:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935520000:0@lo:400: 00000100:00100000:3.0:1787380253.435278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380253.435308:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935519744 00000100:00100000:3.0:1787380253.435314:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935519744 00000100:00100000:3.0:1787380253.435373:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935519872 00000100:00100000:3.0:1787380253.435376:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935519872 00000100:00100000:3.0:1787380253.435403:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380253.435411:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935519744:12345-0@lo:400: 00000100:00100000:3.0:1787380253.435457:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935519744:12345-0@lo:400: Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380253.435463:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380253.435478:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380253.435484:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935519872:12345-0@lo:400: 00000100:00100000:3.0:1787380253.435514:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935519872:12345-0@lo:400: Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380253.435519:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380253.435534:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935519616 00000100:00100000:3.0:1787380253.435538:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935519616 00000100:00100000:3.0:1787380253.435560:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380253.435566:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3302:x1874203935519616:12345-0@lo:400: 00000100:00100000:3.0:1787380253.435603:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3302:x1874203935519616:12345-0@lo:400: Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380253.435609:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380253.435638:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520000 00000100:00100000:3.0:1787380253.435641:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520000 00000100:00100000:3.0:1787380253.435664:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380253.435670:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935520000:12345-0@lo:400: 00000100:00100000:3.0:1787380253.435697:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935520000:12345-0@lo:400: Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380253.435703:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787380253.435720:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380253.435724:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787380253.435762:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5f36d80 x1874203935520000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380253.435775:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935520000:0@lo:400: 00010000:00080000:3.0:1787380253.435785:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5f35500 x1874203935519872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380253.435792:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935519872:0@lo:400: 00000100:00100000:3.0:1787380253.435817:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935519616:0@lo:400: 00010000:00080000:3.0:1787380253.435826:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5f36a00 x1874203935519744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380253.435833:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935519744:0@lo:400: 00000100:00100000:0.0:1787380253.947025:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935520128:0@lo:13: 00000100:00100000:0.0:1787380253.947087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380253.947152:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520128 00000100:00100000:0.0:1787380253.947158:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520128 00000100:00100000:0.0:1787380253.947195:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380253.947203:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935520128:12345-0@lo:13: 00002000:00000024:0.0:1787380253.947233:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380253.947278:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935520128:12345-0@lo:13: Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380253.947285:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787380253.947321:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9688e7b800 x1874203935520128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380253.947352:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935520128:0@lo:13: 00010000:00010000:0.0:1787380254.202404:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380255.226054:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787380255.431194:0:7464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787380255.431198:0:7464:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787380255.435281:0:7464:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d969f0ea800 00000020:01000004:2.0:1787380255.435304:0:7464:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787380255.435317:0:7464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787380255.435331:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d9687734d40) 00000020:00000080:2.0:1787380255.435365:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787380255.493030:0:7464:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787380255.493300:0:7464:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787380255.568121:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787380255.586585:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787380255.586621:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787380255.586677:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787380255.586705:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787380255.587239:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787380255.587251:0:7464:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787380255.587260:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x651a07d1188422e6 00000020:01000004:2.0:1787380255.587266:0:7464:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787380255.587287:0:7464:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787380255.587290:0:7464:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787380255.587301:0:7464:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787380255.587325:0:7464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787380255.587329:0:7464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787380255.647307:0:7464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787380255.647368:0:7464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.114@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787380255.647373:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787380255.647375:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787380255.647376:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380255.647377:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380255.647378:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380255.647379:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380255.647385:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380255.647387:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380255.647388:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380255.647390:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380255.647391:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380255.647395:0:7464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787380255.647398:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380255.647399:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787380255.647400:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380255.647401:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380255.647402:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380255.647403:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380255.647404:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380255.647405:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380255.647406:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380255.647407:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380255.647408:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380255.647440:0:7464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787380255.647458:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935520256:0@lo:253: 00000100:00100000:2.0:1787380255.647523:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.647995:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380255.648141:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520256 00000100:00100000:3.0:1787380255.648153:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520256 00000100:00100000:3.0:1787380255.648210:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380255.648229:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:7464:x1874203935520256:12345-0@lo:253: 20000000:01000000:3.0:1787380255.648267:0:5780:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787380255.648273:0:5780:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787380255.648279:0:5780:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787380255.648284:0:5780:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787380255.653523:0:5780:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380255.653751:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787380255.653765:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787380255.653804:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787380255.653812:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787380255.653843:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787380255.654030:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787380255.660784:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787380255.660984:0:5780:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.114@tcp 20000000:01000000:1.0:1787380255.660991:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.114@tcp (null) (null) (null) 00000040:00080000:1.0:1787380255.661080:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787380255.661089:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787380255.661197:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787380255.661206:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.114@tcp (null) (null) 00000040:00080000:1.0:1787380255.661250:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787380255.661265:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787380255.661314:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787380255.661420:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787380255.663103:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787380255.663132:0:5780:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.114@tcp 20000000:01000000:1.0:1787380255.663134:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.114@tcp (null) (null) (null) 00000040:00080000:1.0:1787380255.663182:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787380255.663190:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787380255.663221:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787380255.663228:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.114@tcp (null) (null) 00000040:00080000:1.0:1787380255.663278:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787380255.663292:0:5780:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787380255.663389:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787380255.663429:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787380255.663445:0:5780:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787380255.663448:0:5780:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787380255.663451:0:5780:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787380255.663706:0:5780:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787380255.663722:0:5780:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787380255.663982:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787380255.663985:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787380255.665833:0:7465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787380255.665944:0:7465:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787380255.665992:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787380255.666434:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787380255.666480:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787380255.666536:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787380255.666552:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787380255.666560:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380255.673569:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380255.673652:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380255.673709:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787380255.674103:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787380255.674142:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787380255.674199:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787380255.674213:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787380255.674215:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787380255.674833:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787380255.675021:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787380255.675059:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787380255.675122:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787380255.675135:0:5780:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787380255.675137:0:5780:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380255.676514:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380255.676577:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380255.676642:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787380255.677143:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787380255.677421:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787380255.677458:0:5780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787380255.677480:0:5780:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787380255.677482:0:5780:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787380255.677490:0:5780:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787380255.677510:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677529:0:5780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842237 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677535:0:5780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842261 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677542:0:5780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884228b expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677548:0:5780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188422a7 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677555:0:5780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188422ca expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677571:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677616:0:5780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188422ca expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.677633:0:5780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188422ca expref: 16 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.677649:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520384:0@lo:104: 00000100:00100000:2.0:1787380255.677721:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380255.678272:0:5780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188422a7 expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.678283:0:5780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188422a7 expref: 16 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.678293:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520512:0@lo:104: 00010000:00010000:2.0:1787380255.678395:0:5780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d11884228b expref: 16 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.678405:0:5780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d11884228b expref: 16 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.678414:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520640:0@lo:104: 00010000:00010000:2.0:1787380255.678445:0:5780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842261 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.678453:0:5780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842261 expref: 16 pid: 5781 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.678470:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520768:0@lo:104: 00010000:00010000:2.0:1787380255.678494:0:5780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842237 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.678501:0:5780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842237 expref: 16 pid: 5780 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.678510:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520896:0@lo:104: 00000100:00100000:2.0:1787380255.678525:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380255.678607:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787380255.678626:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.678651:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.678659:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.678666:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.678678:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520384 00000100:00100000:0.0:1787380255.678683:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520384 00000100:00100000:0.0:1787380255.678717:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520512 00000100:00100000:0.0:1787380255.678720:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520512 00000100:00100000:0.0:1787380255.678728:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520640 00000100:00100000:0.0:1787380255.678730:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520640 00000100:00100000:0.0:1787380255.678738:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520768 00000100:00100000:0.0:1787380255.678740:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520768 00000100:00100000:0.0:1787380255.678748:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935520896 00000100:00100000:0.0:1787380255.678750:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935520896 00000100:00100000:0.0:1787380255.678761:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380255.678768:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96923a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+7:5780:x1874203935520384:12345-0@lo:104: 00010000:00010000:0.0:1787380255.678778:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.678902:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380255.678908:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96923a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+7:5780:x1874203935520384:12345-0@lo:104: Request processed in 141us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.678915:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380255.678966:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380255.678973:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:5780:x1874203935520512:12345-0@lo:104: 00010000:00010000:0.0:1787380255.678981:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679015:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380255.679020:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:5780:x1874203935520512:12345-0@lo:104: Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.679026:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380255.679039:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380255.679045:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:5780:x1874203935520640:12345-0@lo:104: 00010000:00010000:0.0:1787380255.679051:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679082:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787380255.679087:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:5780:x1874203935520640:12345-0@lo:104: Request processed in 43us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.679093:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380255.679105:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380255.679110:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:5780:x1874203935520768:12345-0@lo:104: 00010000:00010000:0.0:1787380255.679118:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679140:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787380255.679145:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:5780:x1874203935520768:12345-0@lo:104: Request processed in 36us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.679150:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380255.679160:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380255.679166:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5780:x1874203935520896:12345-0@lo:104: 00010000:00010000:0.0:1787380255.679172:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679195:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787380255.679199:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5780:x1874203935520896:12345-0@lo:104: Request processed in 34us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.679205:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787380255.679220:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787380255.679225:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679232:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380255.679243:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679251:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380255.679259:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380255.679264:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380255.679295:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679302:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380255.679317:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679324:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163b600/0x651a07d1188422ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422d1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679368:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787380255.679372:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679379:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380255.679382:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679389:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380255.679406:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380255.679411:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380255.679424:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679429:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380255.679444:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679451:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216c000/0x651a07d1188422a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422ae expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679462:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787380255.679465:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679471:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380255.679474:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679481:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380255.679487:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380255.679492:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380255.679510:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679515:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380255.679521:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679527:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884228b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842292 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679536:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380255.679539:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679544:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f2800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380255.679547:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679553:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380255.679559:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380255.679564:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380255.679575:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679580:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380255.679585:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679599:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f2800/0x651a07d118842261 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842268 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679608:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380255.679610:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679615:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f3600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380255.679618:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679623:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380255.679629:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380255.679633:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380255.679646:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679652:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380255.679656:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679662:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884223e expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.679675:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380255.679684:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380255.679686:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380255.679699:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935521024:0@lo:103: 00000100:00100000:0.0:1787380255.679730:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.679750:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935521536:0@lo:103: 00000100:00100000:0.0:1787380255.679768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.679785:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380255.679791:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935521408:0@lo:103: 00000100:00100000:0.0:1787380255.679809:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.679835:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935521152:0@lo:103: 00000100:00100000:0.0:1787380255.679855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.679865:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380255.679869:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935521280:0@lo:103: 00000100:00100000:0.0:1787380255.679887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.679911:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521024 00000100:00100000:0.0:1787380255.679915:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521024 00010000:00010000:0.0:1787380255.679933:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188422ca expref: 17 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.679947:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521536 00000100:00100000:0.0:1787380255.679949:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521536 00010000:00010000:0.0:1787380255.679972:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842237 expref: 18 pid: 5780 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.679983:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521408 00000100:00100000:0.0:1787380255.679985:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521408 00010000:00010000:0.0:1787380255.680008:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842261 expref: 19 pid: 5781 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.680020:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521152 00000100:00100000:0.0:1787380255.680027:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521152 00010000:00010000:0.0:1787380255.680039:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188422a7 expref: 20 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.680048:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521280 00000100:00100000:0.0:1787380255.680051:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521280 00010000:00010000:0.0:1787380255.680058:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884228b expref: 21 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.680069:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380255.680082:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+21:3302:x1874203935521024:12345-0@lo:103: 00010000:00010000:0.0:1787380255.680091:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380255.680096:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188422ca expref: 21 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680107:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188422ca expref: 21 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680122:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380255.680151:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+21:3302:x1874203935521024:12345-0@lo:103: Request processed in 76us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.680158:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380255.680172:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380255.680178:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+20:3302:x1874203935521536:12345-0@lo:103: 00010000:00010000:0.0:1787380255.680185:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380255.680189:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842237 expref: 20 pid: 5780 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680197:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842237 expref: 20 pid: 5780 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680217:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380255.680239:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+20:3302:x1874203935521536:12345-0@lo:103: Request processed in 61us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.680245:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380255.680257:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380255.680263:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935521408:12345-0@lo:103: 00010000:00010000:0.0:1787380255.680269:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380255.680273:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842261 expref: 19 pid: 5781 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680281:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842261 expref: 19 pid: 5781 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680290:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380255.680309:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935521408:12345-0@lo:103: Request processed in 47us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.680315:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380255.680326:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380255.680331:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:3299:x1874203935521152:12345-0@lo:103: 00010000:00010000:0.0:1787380255.680356:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380255.680360:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188422a7 expref: 18 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680368:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188422a7 expref: 18 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680376:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380255.680397:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:3299:x1874203935521152:12345-0@lo:103: Request processed in 66us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.680409:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380255.680421:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380255.680427:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:3299:x1874203935521280:12345-0@lo:103: 00010000:00010000:0.0:1787380255.680433:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380255.680438:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884228b expref: 17 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680447:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d11884228b expref: 17 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680458:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680466:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680478:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680485:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680491:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680496:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680502:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380255.680505:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680517:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680525:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.680534:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380255.680556:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:3299:x1874203935521280:12345-0@lo:103: Request processed in 129us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.680562:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380255.680598:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935521280:0@lo:103: 00000100:00100000:0.0:1787380255.680606:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935521152:0@lo:103: 00000100:00100000:0.0:1787380255.680627:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935521408:0@lo:103: 00000100:00100000:0.0:1787380255.680633:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935521024:0@lo:103: 00000100:00100000:0.0:1787380255.680638:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935521536:0@lo:103: 00010000:00010000:2.0:1787380255.681106:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380255.689278:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163a800/0x651a07d1188422d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188422ca expref: 16 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380255.689303:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520384:0@lo:104: 00010000:00010000:1.0:1787380255.689332:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216d000/0x651a07d1188422ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188422a7 expref: 15 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380255.689431:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520512:0@lo:104: 00010000:00010000:1.0:1787380255.689445:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680030000/0x651a07d118842292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d11884228b expref: 14 pid: 5779 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380255.689455:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520640:0@lo:104: 00010000:00010000:1.0:1787380255.689465:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680030400/0x651a07d118842268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842261 expref: 13 pid: 5781 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380255.689473:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520768:0@lo:104: 00010000:00010000:1.0:1787380255.689481:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b200/0x651a07d11884223e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842237 expref: 12 pid: 5780 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380255.689489:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5780:1874203935520896:0@lo:104: 00010000:00010000:1.0:1787380255.689522:0:5780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380255.689550:0:5780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380255.689556:0:5780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380255.689562:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216c800/0x651a07d1188422ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380255.689578:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787380255.730376:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:7464:x1874203935520256:12345-0@lo:253: Request processed in 82144us (82845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.730390:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787380255.730453:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935520256:0@lo:253: 10000000:01000000:2.0:1787380255.730467:0:7464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787380255.730471:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380255.730473:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787380255.730475:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380255.730476:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787380255.730477:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380255.730478:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380255.730480:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380255.730481:0:7464:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787380255.730483:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380255.730484:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787380255.730506:0:7464:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d969f0ea800 from lustre-OST0001 10000000:01000000:2.0:1787380255.730531:0:7464:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787380255.730534:0:7464:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787380255.730541:0:7464:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d9695a5b380 local copy 10000000:01000000:2.0:1787380255.730545:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787380255.730588:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.730600:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.730609:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.730627:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935521664:0@lo:101: 00000100:00100000:2.0:1787380255.730659:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.730689:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521664 00000100:00100000:2.0:1787380255.730694:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521664 00000100:00100000:2.0:1787380255.730726:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787380255.730735:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+11:7464:x1874203935521664:12345-0@lo:101: 00010000:00010000:2.0:1787380255.730747:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380255.730761:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216d800/0x651a07d1188422fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188422f4 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.730781:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216d800/0x651a07d1188422fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188422f4 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.730791:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216d800/0x651a07d1188422fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188422f4 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.730799:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d800, rc 0) 00000100:00100000:2.0:1787380255.730823:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:7464:x1874203935521664:12345-0@lo:101: Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.730828:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787380255.730864:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.730882:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935521664:0@lo:101: 00010000:00010000:2.0:1787380255.730894:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.730902:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.730988:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935521792:0@lo:501: 00000100:00100000:2.0:1787380255.731013:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.731032:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521792 00000100:00100000:2.0:1787380255.731036:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521792 00000100:00100000:2.0:1787380255.731070:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787380255.731076:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:7464:x1874203935521792:12345-0@lo:501: 00000100:00100000:2.0:1787380255.731234:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:7464:x1874203935521792:12345-0@lo:501: Request processed in 157us (220us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380255.731241:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787380255.731263:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.731275:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935521792:0@lo:501: 10000000:01000000:2.0:1787380255.731285:0:7464:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787380255.731309:0:7464:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787380255.731314:0:7464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731322:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731328:0:7464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731370:0:7464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787380255.731386:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d969f0ea800 10000000:01000000:2.0:1787380255.731390:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787380255.731395:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787380255.731397:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380255.731401:0:7464:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787380255.731404:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787380255.731417:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731423:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731430:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.731440:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935521920:0@lo:101: 00000100:00100000:2.0:1787380255.731464:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.731483:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935521920 00000100:00100000:2.0:1787380255.731487:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935521920 00000100:00100000:2.0:1787380255.731507:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787380255.731513:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:7464:x1874203935521920:12345-0@lo:101: 00010000:00010000:2.0:1787380255.731519:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380255.731528:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842302 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731541:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842302 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731562:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842302 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731568:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c800, rc 0) 00000100:00100000:2.0:1787380255.731588:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935521920:12345-0@lo:101: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.731594:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787380255.731615:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.731627:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935521920:0@lo:101: 00010000:00010000:2.0:1787380255.731637:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.731644:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380255.731687:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522048:0@lo:501: 00000100:00100000:2.0:1787380255.731707:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.731723:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522048 00000100:00100000:2.0:1787380255.731726:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522048 00000100:00100000:2.0:1787380255.731744:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787380255.731750:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522048:12345-0@lo:501: 00000100:00100000:2.0:1787380255.731871:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522048:12345-0@lo:501: Request processed in 120us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.731877:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787380255.731899:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.731910:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522048:0@lo:501: 00000100:00100000:2.0:1787380255.731939:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522176:0@lo:503: 00000100:00100000:2.0:1787380255.731985:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.732004:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522176 00000100:00100000:2.0:1787380255.732008:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522176 00000100:00100000:2.0:1787380255.732027:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787380255.732032:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522176:12345-0@lo:503: 00000100:00100000:2.0:1787380255.732153:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522176:12345-0@lo:503: Request processed in 120us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.732159:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787380255.732186:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.732199:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522176:0@lo:503: 00000040:00080000:2.0:1787380255.732454:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380255.732505:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522304:0@lo:502: 00000100:00100000:2.0:1787380255.732536:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.732558:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522304 00000100:00100000:2.0:1787380255.732561:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522304 00000100:00100000:2.0:1787380255.732582:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787380255.732587:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522304:12345-0@lo:502: 00000100:00100000:2.0:1787380255.732702:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522304:12345-0@lo:502: Request processed in 113us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.732708:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787380255.732736:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ba13300 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.732748:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522304:0@lo:502: 00010000:00010000:0.0:1787380255.733198:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380255.733206:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.733214:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380255.733218:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.733227:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380255.733245:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380255.733251:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380255.733271:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.733276:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380255.733292:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.733298:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d1188422f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x651a07d1188422fb expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.733311:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380255.733313:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380255.733314:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380255.733321:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380255.733330:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935522432:0@lo:103: 00000100:00100000:0.0:1787380255.733377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.733412:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522432 00000100:00100000:0.0:1787380255.733416:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522432 00000100:00100000:0.0:1787380255.733444:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380255.733451:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:3300:x1874203935522432:12345-0@lo:103: 00010000:00010000:0.0:1787380255.733461:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380255.733472:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216d800/0x651a07d1188422fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d1188422f4 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.733483:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380255.733516:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:3300:x1874203935522432:12345-0@lo:103: Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.733523:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380255.733554:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935522432:0@lo:103: 00000040:00080000:2.0:1787380255.733825:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787380255.733881:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787380255.733918:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787380255.733986:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787380255.734024:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787380255.734055:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787380255.734079:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522560:0@lo:502: 00000100:00100000:2.0:1787380255.734114:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.734223:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ba13300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380255.734268:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522560 00000100:00100000:0.0:1787380255.734272:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522560 00000100:00100000:0.0:1787380255.734432:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787380255.734440:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:7464:x1874203935522560:12345-0@lo:502: 00000100:00100000:0.0:1787380255.734969:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:7464:x1874203935522560:12345-0@lo:502: Request processed in 527us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.734977:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787380255.735045:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522560:0@lo:502: 00000040:00080000:1.0:1787380255.735142:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787380255.735153:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787380255.735805:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380255.735813:0:7470:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787380255.735819:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380255.735821:0:7470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787380255.735827:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380255.735840:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d96bd423380) 00000020:00000080:3.0:1787380255.735860:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787380255.735866:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787380255.735937:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d969f0ea800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787380255.735943:0:7470:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787380255.735949:0:7470:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x651a07d118842317 00010000:00010000:3.0:1787380255.740944:0:7470:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787380255.741282:0:7470:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787380255.743933:0:7470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787380255.744271:0:7470:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787380255.752139:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787380255.752791:0:7470:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787380255.756716:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787380255.756728:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380255.756749:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380255.756751:0:7470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787380255.756755:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380255.756759:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380255.756760:0:7470:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787380255.756764:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380255.756765:0:7470:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787380255.756817:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380255.756821:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380255.756823:0:7470:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787380255.756826:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787380255.756979:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787380255.757004:0:7464:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787380255.757029:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.757041:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380255.757048:0:7464:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d969f0ea800 from 1 10000000:01000000:3.0:1787380255.757051:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380255.757083:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.757091:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.757111:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380255.757133:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522688:0@lo:101: 00000100:00100000:3.0:1787380255.758284:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380255.758323:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522688 00000100:00100000:3.0:1787380255.758330:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522688 00000100:00100000:3.0:1787380255.758386:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787380255.758865:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:7464:x1874203935522688:12345-0@lo:101: 00010000:00010000:3.0:1787380255.758881:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380255.758898:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884231e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.758921:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884231e expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.758932:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884231e expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.758941:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163a600, rc 0) 00000100:00100000:3.0:1787380255.758985:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522688:12345-0@lo:101: Request processed in 124us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.758992:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787380255.759035:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380255.759059:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522688:0@lo:101: 00010000:00010000:3.0:1787380255.759073:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.759093:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380255.760604:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522816:0@lo:501: 00000100:00100000:3.0:1787380255.760656:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380255.760688:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317480 going to sleep for 11 seconds 00000100:00100000:1.0:1787380255.760772:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522816 00000100:00100000:1.0:1787380255.760779:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522816 00000100:00100000:1.0:1787380255.760820:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380255.760828:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522816:12345-0@lo:501: 00000100:00100000:1.0:1787380255.761084:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522816:12345-0@lo:501: Request processed in 255us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380255.761092:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787380255.761259:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522816:0@lo:501: 00000100:00100000:2.0:1787380255.761291:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522944:0@lo:503: 00000100:00100000:2.0:1787380255.761330:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.761489:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380255.761696:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935522944 00000100:00100000:3.0:1787380255.761701:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935522944 00000100:00100000:3.0:1787380255.761727:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787380255.761734:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522944:12345-0@lo:503: 00000100:00100000:3.0:1787380255.762053:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935522944:12345-0@lo:503: Request processed in 318us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.762061:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787380255.762630:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935522944:0@lo:503: 00000040:00080000:2.0:1787380255.762883:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380255.762963:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523072:0@lo:502: 00000100:00100000:2.0:1787380255.763006:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.763034:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96959f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380255.763509:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523072 00000100:00100000:3.0:1787380255.763514:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523072 00000100:00100000:3.0:1787380255.763619:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787380255.763628:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935523072:12345-0@lo:502: 00000100:00100000:3.0:1787380255.763821:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935523072:12345-0@lo:502: Request processed in 193us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.763830:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787380255.764318:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523072:0@lo:502: 00000040:00080000:0.0:1787380255.764842:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787380255.764899:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787380255.764929:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523200:0@lo:502: 00000100:00100000:0.0:1787380255.764987:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.765025:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.765502:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523200 00000100:00100000:2.0:1787380255.765509:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523200 00000100:00100000:2.0:1787380255.767646:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787380255.767658:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935523200:12345-0@lo:502: 00000100:00100000:2.0:1787380255.767891:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935523200:12345-0@lo:502: Request processed in 233us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.767898:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787380255.768373:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523200:0@lo:502: 00000040:00080000:0.0:1787380255.769063:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787380255.769079:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787380255.770710:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380255.770728:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380255.770731:0:7474:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787380255.770738:0:7474:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d969f0ea800 00000020:00000080:2.0:1787380255.770740:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787380255.770764:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380255.770768:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380255.770769:0:7474:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787380255.770772:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787380255.771247:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787380255.771271:0:7464:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380255.771296:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.771306:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380255.771460:0:7464:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787380255.771464:0:7464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d969f0ea800 10000000:01000000:0.0:1787380255.771467:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d969f0ea800 10000000:01000000:0.0:1787380255.771471:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787380255.771477:0:7464:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d969f0ea800 from 1 10000000:01000000:0.0:1787380255.771480:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787380255.771512:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.771810:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.771823:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.771843:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523328:0@lo:101: 00000100:00100000:0.0:1787380255.771903:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.771982:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380255.778966:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523328 00000100:00100000:3.0:1787380255.778980:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523328 00000100:00100000:3.0:1787380255.779166:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787380255.779176:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935523328:12345-0@lo:101: 00010000:00010000:3.0:1787380255.779191:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380255.779207:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884232c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.779246:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884232c expref: 14 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.779258:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884232c expref: 14 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.779267:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b400, rc 0) 00000100:00100000:3.0:1787380255.779463:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523328:12345-0@lo:101: Request processed in 288us (7558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.779471:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787380255.780271:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523328:0@lo:101: 00010000:00010000:1.0:1787380255.780290:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380255.780300:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380255.780694:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523456:0@lo:501: 00000100:00100000:1.0:1787380255.780734:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380255.780814:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380255.780850:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523456 00000100:00100000:3.0:1787380255.780855:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523456 00000100:00100000:3.0:1787380255.780925:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787380255.780934:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523456:12345-0@lo:501: 00000100:00100000:3.0:1787380255.781187:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523456:12345-0@lo:501: Request processed in 253us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.781195:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787380255.781256:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523456:0@lo:501: 00000100:00100000:1.0:1787380255.781283:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523584:0@lo:503: 00000100:00100000:1.0:1787380255.781318:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380255.781816:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.781909:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523584 00000100:00100000:2.0:1787380255.781915:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523584 00000100:00100000:2.0:1787380255.781942:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787380255.781949:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523584:12345-0@lo:503: 00000100:00100000:2.0:1787380255.782113:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523584:12345-0@lo:503: Request processed in 164us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.782120:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787380255.782282:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523584:0@lo:503: 00000040:00080000:1.0:1787380255.783045:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380255.783110:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523712:0@lo:502: 00000100:00100000:1.0:1787380255.783233:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380255.783266:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.783751:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523712 00000100:00100000:2.0:1787380255.783757:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523712 00000100:00100000:2.0:1787380255.783792:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787380255.783800:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523712:12345-0@lo:502: 00000100:00100000:2.0:1787380255.784008:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523712:12345-0@lo:502: Request processed in 207us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.784015:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787380255.784250:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523712:0@lo:502: 00000040:00080000:1.0:1787380255.784699:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787380255.784750:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787380255.784796:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787380255.784842:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787380255.784877:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787380255.784966:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787380255.785007:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787380255.785041:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787380255.785090:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787380255.785127:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787380255.785329:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787380255.785791:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787380255.785829:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787380255.785857:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787380255.785902:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787380255.785935:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787380255.785979:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787380255.786026:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787380255.786059:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787380255.786090:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787380255.786137:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787380255.786284:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787380255.786322:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787380255.786656:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787380255.786701:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787380255.786737:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787380255.786786:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787380255.786821:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787380255.786851:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787380255.786895:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787380255.786929:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787380255.786974:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787380255.787010:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787380255.787090:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787380255.787130:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787380255.787513:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787380255.787669:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787380255.787714:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523840:0@lo:502: 00000100:00100000:1.0:1787380255.787785:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380255.787860:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380255.787902:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523840 00000100:00100000:2.0:1787380255.787908:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523840 00000100:00100000:2.0:1787380255.788008:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787380255.788018:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523840:12345-0@lo:502: 00000100:00100000:2.0:1787380255.788302:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935523840:12345-0@lo:502: Request processed in 284us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.788310:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787380255.788440:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935523840:0@lo:502: 00000040:00080000:1.0:1787380255.788505:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787380255.788516:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787380255.789168:0:7475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787380255.789182:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d96990499c0) 00000020:00000080:1.0:1787380255.789204:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787380255.789367:0:7475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d969f0ea800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787380255.789372:0:7475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d969f0ea800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787380255.789374:0:7475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d969f0ea800 3 00010000:00080000:1.0:1787380255.789409:0:7475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d96bbe10800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1787380255.791006:0:7475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787380255.791092:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787380255.791122:0:7475:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787380255.791132:0:7475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x651a07d118842341 00000100:00080000:1.0:1787380255.791140:0:7475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380255.791145:0:7475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d96bbe10800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1787380255.791187:0:7475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d96bd43dc00 x1874203935523968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380255.791218:0:7475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787380255.794372:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935524096:0@lo:400: 00000100:00100000:3.0:1787380255.794451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380255.794497:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935524224:0@lo:400: 00000100:00100000:3.0:1787380255.794693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380255.794715:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380255.794721:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935524352:0@lo:400: 00000100:00100000:3.0:1787380255.794747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380255.794778:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524096 00000100:00100000:3.0:1787380255.794784:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524096 00000100:00100000:3.0:1787380255.794833:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524224 00000100:00100000:3.0:1787380255.794836:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524224 00000100:00100000:3.0:1787380255.794860:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380255.794867:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935524096:12345-0@lo:400: 00000100:00100000:3.0:1787380255.794916:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935524096:12345-0@lo:400: Request processed in 49us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.794924:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380255.794937:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380255.794943:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935524224:12345-0@lo:400: 00000100:00100000:3.0:1787380255.794983:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935524224:12345-0@lo:400: Request processed in 40us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.794989:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380255.795008:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524352 00000100:00100000:3.0:1787380255.795011:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524352 00000100:00100000:3.0:1787380255.795031:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380255.795036:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935524352:12345-0@lo:400: 00000100:00100000:3.0:1787380255.795062:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935524352:12345-0@lo:400: Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.795068:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787380255.795084:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380255.795088:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787380255.795113:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5f37100 x1874203935524096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380255.795126:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935524096:0@lo:400: 00010000:00080000:3.0:1787380255.795150:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5f36d80 x1874203935524352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380255.795475:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935524352:0@lo:400: 00010000:00080000:3.0:1787380255.795495:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5f35500 x1874203935524224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380255.795504:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935524224:0@lo:400: 00000100:00100000:2.0:1787380255.796290:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874203935523968:0@lo:38: 00000100:00100000:2.0:1787380255.796353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380255.796712:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935523968 00000100:00100000:3.0:1787380255.796718:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935523968 00000100:00100000:3.0:1787380255.796746:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380255.796752:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3298:x1874203935523968:12345-0@lo:38: 00010000:00080000:3.0:1787380255.796776:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1787380255.796806:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x651a07d118842348 00000004:00100000:3.0:1787380255.796819:0:5787:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787380255.796849:0:5787:0:(import.c:65:import_set_state_nolock()) ffff9d96bd217800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1787380255.798301:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1787380255.798482:0:7476:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9d96bd43d880 x1874203935524480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380255.798493:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 0 seconds 00000020:01000000:0.0:1787380255.798579:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787380255.798601:0:7464:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787380255.798626:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.798636:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787380255.798680:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787380255.798683:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787380255.798684:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380255.798689:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380255.798690:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380255.798692:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380255.798693:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380255.798694:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380255.798696:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380255.798697:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380255.798698:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787380255.798702:0:7464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787380255.798705:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787380255.798706:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787380255.798707:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380255.798708:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380255.798709:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380255.798710:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380255.798711:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380255.798712:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380255.798712:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380255.798713:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380255.798714:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787380255.798728:0:7464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787380255.798738:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935524608:0@lo:253: 00000100:00100000:0.0:1787380255.798788:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.798817:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380255.798836:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524608 00000100:00100000:0.0:1787380255.798841:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524608 00000100:00100000:0.0:1787380255.798877:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787380255.798885:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7464:x1874203935524608:12345-0@lo:253: 20000000:01000000:0.0:1787380255.798909:0:5779:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787380255.798922:0:5779:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787380255.799368:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874203935523968:12345-0@lo:38: Request processed in 2613us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.799377:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787380255.803561:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43dc00 x1874203935523968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380255.803575:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380255.803585:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787380255.803593:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787380255.803598:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787380255.803602:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96bbe10800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787380255.803621:0:3298:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004428d0da): req@ffff9d96bd43d880 x1874203935524480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380255.803639:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874203935523968:0@lo:38: 00000100:00100000:1.0:1787380255.804856:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380255.805099:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380255.805587:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524480 00000100:00100000:0.0:1787380255.805596:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524480 00000100:00100000:0.0:1787380255.805701:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380255.805710:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7476:x1874203935524480:12345-0@lo:901: 00000100:00080000:3.0:1787380255.806488:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380255.807896:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7476:x1874203935524480:12345-0@lo:901: Request processed in 2179us (3035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.808494:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787380255.811238:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96bd43d880 x1874203935524480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787380271 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380255.811256:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7476:1874203935524480:0@lo:901: 20000000:01000000:3.0:1787380255.899866:0:5779:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787380255.899885:0:5779:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787380255.899947:0:5802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787380255.899961:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787380255.899981:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.899999:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842299 expref: 14 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.900008:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.900099:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842299 expref: 14 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.900114:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842299 expref: 14 pid: 5781 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.900127:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1874203935524736:0@lo:104: 00000100:00100000:0.0:1787380255.900314:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380255.900585:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524736 00000100:00100000:2.0:1787380255.900592:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524736 00000100:00100000:2.0:1787380255.900643:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380255.900651:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5802:x1874203935524736:12345-0@lo:104: 00010000:00010000:2.0:1787380255.900664:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.900708:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787380255.900713:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:5802:x1874203935524736:12345-0@lo:104: Request processed in 63us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380255.900718:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787380255.900736:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380255.900741:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.900747:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1787380255.900751:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.900758:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380255.900765:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380255.900770:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787380255.901490:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380255.901943:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5802:1874203935524736:0@lo:104: 00010000:00010000:0.0:1787380255.901979:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.902121:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.902137:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787380255.904869:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935524864:0@lo:103: 00000100:00100000:3.0:1787380255.904944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.905034:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524864 00000100:00100000:0.0:1787380255.905139:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524864 00010000:00010000:0.0:1787380255.906658:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842299 expref: 15 pid: 5781 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380255.906696:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380255.906707:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:3299:x1874203935524864:12345-0@lo:103: 00010000:00010000:0.0:1787380255.906722:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380255.906727:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842299 expref: 15 pid: 5781 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906739:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842299 expref: 15 pid: 5781 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906757:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96813f2000/0x651a07d1188422a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842299 expref: 15 pid: 5781 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906772:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906779:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787380255.906794:0:5771:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006834553s 00010000:00010000:0.0:1787380255.906799:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906806:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906813:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906835:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906842:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9680030000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380255.906846:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906855:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906879:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380255.906889:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380255.906948:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:3299:x1874203935524864:12345-0@lo:103: Request processed in 244us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.906966:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380255.908168:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935524864:0@lo:103: 00010000:00010000:3.0:1787380255.908202:0:5802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.908213:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380255.908219:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680030000/0x651a07d11884234f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.909353:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.909366:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d118842299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188422a0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380255.911363:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380255.911369:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380255.911371:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380255.946879:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:7464:x1874203935524608:12345-0@lo:253: Request processed in 147986us (148081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.946896:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787380255.947018:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aaaa441-7de5-4747-b366-e84ba9a288bb:7464:1874203935524608:0@lo:253: 10000000:01000000:0.0:1787380255.947033:0:7464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787380255.947036:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787380255.947038:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787380255.947039:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380255.947040:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380255.947041:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380255.947042:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380255.947044:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380255.947045:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380255.947046:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380255.947048:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380255.947049:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787380255.947070:0:7464:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787380255.953845:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380255.954057:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787380255.954256:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380255.954435:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787380255.954629:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380255.954876:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787380255.957262:0:7464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787380256.225106:0:7464:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787380256.225114:0:7464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787380256.225145:0:7464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787380256.225264:0:7464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787380256.225281:0:7464:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787380256.225304:0:7464:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787380256.256358:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380257.271501:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380258.295565:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380259.063563:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935524992:0@lo:13: 00000100:00100000:3.0:1787380259.063635:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.063822:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935524992 00000100:00100000:0.0:1787380259.063830:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935524992 00000100:00100000:0.0:1787380259.064071:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380259.064080:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935524992:12345-0@lo:13: 00002000:00000024:0.0:1787380259.064119:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380259.064178:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935524992:12345-0@lo:13: Request processed in 99us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.064186:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787380259.064310:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380259.064362:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e78380 x1874203935524992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380259.064525:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935524992:0@lo:13: 00010000:00010000:0.0:1787380259.325262:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380260.343558:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380261.125516:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935525120:0@lo:400: 00000100:00100000:1.0:1787380261.125588:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380261.125646:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935525632:0@lo:400: 00000100:00100000:1.0:1787380261.125672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380261.125697:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380261.125704:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935525248:0@lo:400: 00000100:00100000:1.0:1787380261.125724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380261.125784:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935525120 00000100:00100000:0.0:1787380261.125792:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935525120 00000100:00100000:0.0:1787380261.125841:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787380261.125851:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:3301:x1874203935525120:12345-0@lo:400: 00000100:00100000:0.0:1787380261.125916:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:3301:x1874203935525120:12345-0@lo:400: Request processed in 66us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380261.125933:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787380261.126058:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935525120:0@lo:400: 00000100:00100000:0.0:1787380261.127072:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935525504:0@lo:400: 00000100:00100000:0.0:1787380261.127115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380261.127159:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380261.127166:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935525376:0@lo:400: 00000100:00100000:0.0:1787380261.127187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380261.127321:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935525504 00000100:00100000:1.0:1787380261.127326:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935525504 00000100:00100000:1.0:1787380261.127403:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380261.127412:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935525504:12345-0@lo:400: 00000100:00100000:1.0:1787380261.127470:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935525504:12345-0@lo:400: Request processed in 59us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380261.127477:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787380261.127510:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e7a300 x1874203935525504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380261.127523:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935525504:0@lo:400: 00000100:00100000:3.0:1787380261.135356:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935525632 00000100:00100000:3.0:1787380261.135368:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935525632 00000100:00100000:3.0:1787380261.135413:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935525248 00000100:00100000:3.0:1787380261.135416:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935525248 00000100:00100000:3.0:1787380261.135428:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935525376 00000100:00100000:3.0:1787380261.135431:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935525376 00000100:00100000:3.0:1787380261.135447:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787380261.135455:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935525632:12345-0@lo:400: 00000100:00100000:3.0:1787380261.135542:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935525632:12345-0@lo:400: Request processed in 87us (9867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380261.135549:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787380261.135575:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380261.135593:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935525248:12345-0@lo:400: 00000100:00100000:3.0:1787380261.135624:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935525248:12345-0@lo:400: Request processed in 33us (9899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380261.135630:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380261.135642:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787380261.135648:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935525376:12345-0@lo:400: 00000100:00100000:3.0:1787380261.135683:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935525376:12345-0@lo:400: Request processed in 36us (8494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380261.135689:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787380261.135712:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380261.135716:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380261.135750:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e79180 x1874203935525376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380261.135764:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935525376:0@lo:400: 00010000:00080000:3.0:1787380261.135798:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e78a80 x1874203935525248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380261.135808:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935525248:0@lo:400: 00010000:00080000:3.0:1787380261.135824:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e79f80 x1874203935525632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380261.135832:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935525632:0@lo:400: 00010000:00010000:0.0:1787380261.369960:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380262.392139:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787380262.647835:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787380262.647842:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d96ba3b2800 from 30 10000000:01000000:1.0:1787380262.647847:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380262.648002:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380262.648013:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380262.648024:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380262.648048:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935525760:0@lo:101: 00000100:00100000:1.0:1787380262.648115:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380262.648229:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.656035:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935525760 00000100:00100000:2.0:1787380262.656049:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935525760 00000100:00100000:2.0:1787380262.656105:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787380262.656115:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935525760:12345-0@lo:101: 00010000:00010000:2.0:1787380262.656131:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380262.656148:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842356 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.656176:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842356 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.656186:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842356 expref: 14 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.656203:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216de00, rc 0) 00000100:00100000:2.0:1787380262.656276:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935525760:12345-0@lo:101: Request processed in 162us (8159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.656283:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787380262.656351:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935525760:0@lo:101: 00010000:00010000:2.0:1787380262.656368:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.656378:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380262.656437:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935525888:0@lo:501: 00000100:00100000:2.0:1787380262.656466:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.656492:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.656506:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935525888 00000100:00100000:2.0:1787380262.656509:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935525888 00000100:00100000:2.0:1787380262.656527:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787380262.656533:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935525888:12345-0@lo:501: 00000100:00100000:2.0:1787380262.659123:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935525888:12345-0@lo:501: Request processed in 2581us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.659136:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787380262.661982:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935525888:0@lo:501: 00000100:00100000:3.0:1787380262.662042:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526016:0@lo:503: 00000100:00100000:3.0:1787380262.662108:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.662160:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.663086:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526016 00000100:00100000:0.0:1787380262.663095:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526016 00000100:00100000:0.0:1787380262.663151:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787380262.663162:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935526016:12345-0@lo:503: 00000100:00100000:0.0:1787380262.663569:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935526016:12345-0@lo:503: Request processed in 407us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.663583:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787380262.663647:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526016:0@lo:503: 00000100:00100000:0.0:1787380262.666008:0:7753:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7753:1874203935526144:0@lo:502: 00000100:00100000:0.0:1787380262.666086:0:7753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380262.666138:0:7753:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96959f2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.668670:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526144 00000100:00100000:3.0:1787380262.668686:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526144 00000100:00100000:3.0:1787380262.668746:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787380262.668756:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7753:x1874203935526144:12345-0@lo:502: 00000100:00100000:3.0:1787380262.669139:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7753:x1874203935526144:12345-0@lo:502: Request processed in 383us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.669147:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787380262.669854:0:7753:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7753:1874203935526144:0@lo:502: 00000100:00100000:2.0:1787380262.670044:0:7753:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7753:1874203935526272:0@lo:502: 00000100:00100000:2.0:1787380262.670099:0:7753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.670136:0:7753:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.671075:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526272 00000100:00100000:3.0:1787380262.671084:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526272 00000100:00100000:3.0:1787380262.671137:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787380262.671148:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7753:x1874203935526272:12345-0@lo:502: 00000100:00100000:0.0:1787380262.673640:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:7753:x1874203935526272:12345-0@lo:502: Request processed in 2486us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.673654:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787380262.674202:0:7753:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7753:1874203935526272:0@lo:502: 00000040:00080000:2.0:1787380262.674241:0:7753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787380262.674873:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787380262.674907:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380262.674926:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.674937:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380262.674948:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787380262.674950:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787380262.674953:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787380262.674987:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.674996:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.675004:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380262.675037:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526400:0@lo:101: 00000100:00100000:3.0:1787380262.675086:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.675127:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.675258:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526400 00000100:00100000:2.0:1787380262.675264:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526400 00000100:00100000:2.0:1787380262.675301:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787380262.675309:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935526400:12345-0@lo:101: 00010000:00010000:2.0:1787380262.675321:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380262.675333:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842364 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.675394:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842364 expref: 15 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.675404:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842364 expref: 15 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.675413:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d800, rc 0) 00000100:00100000:2.0:1787380262.675459:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935526400:12345-0@lo:101: Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.675466:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787380262.676125:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526400:0@lo:101: 00010000:00010000:0.0:1787380262.676142:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.676154:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380262.676204:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526528:0@lo:501: 00000100:00100000:0.0:1787380262.676236:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380262.676261:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96959f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.676275:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526528 00000100:00100000:0.0:1787380262.676279:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526528 00000100:00100000:0.0:1787380262.676307:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787380262.676314:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935526528:12345-0@lo:501: 00000100:00100000:0.0:1787380262.677584:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935526528:12345-0@lo:501: Request processed in 1264us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.677596:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787380262.677677:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526528:0@lo:501: 00000100:00100000:3.0:1787380262.677716:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526656:0@lo:503: 00000100:00100000:3.0:1787380262.677765:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.677991:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.678037:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526656 00000100:00100000:0.0:1787380262.678049:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526656 00000100:00100000:0.0:1787380262.678087:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787380262.678095:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935526656:12345-0@lo:503: 00000100:00100000:0.0:1787380262.678428:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935526656:12345-0@lo:503: Request processed in 333us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.678437:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787380262.678807:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935526656:0@lo:503: 00000100:00100000:3.0:1787380262.679259:0:7754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7754:1874203935526784:0@lo:502: 00000100:00100000:3.0:1787380262.679308:0:7754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.679372:0:7754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.679450:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526784 00000100:00100000:0.0:1787380262.679455:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526784 00000100:00100000:0.0:1787380262.679494:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787380262.679502:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:7754:x1874203935526784:12345-0@lo:502: 00000100:00100000:0.0:1787380262.679685:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:7754:x1874203935526784:12345-0@lo:502: Request processed in 183us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.679693:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787380262.679848:0:7754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7754:1874203935526784:0@lo:502: 00000020:01000000:3.0:1787380262.679870:0:7754:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380262.679878:0:7754:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380262.679881:0:7754:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380262.679896:0:7754:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380262.679898:0:7754:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787380262.679926:0:7754:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7754:1874203935526912:0@lo:502: 00000100:00100000:3.0:1787380262.679961:0:7754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.679987:0:7754:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.680093:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935526912 00000100:00100000:0.0:1787380262.680097:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935526912 00000100:00100000:0.0:1787380262.680131:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787380262.680139:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:7754:x1874203935526912:12345-0@lo:502: 00000100:00100000:0.0:1787380262.680259:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:7754:x1874203935526912:12345-0@lo:502: Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.680266:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787380262.680364:0:7754:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7754:1874203935526912:0@lo:502: 00000020:01000000:3.0:1787380262.680381:0:7754:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380262.680385:0:7754:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380262.680387:0:7754:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787380262.680390:0:7754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787380262.680563:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787380262.680580:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787380262.680589:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.680600:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380262.680621:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787380262.680624:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d968b549800 from 30 10000000:01000000:0.0:1787380262.680627:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787380262.680652:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.680661:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.680669:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380262.680683:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527040:0@lo:101: 00000100:00100000:0.0:1787380262.680715:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380262.680739:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.680754:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527040 00000100:00100000:0.0:1787380262.680758:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527040 00000100:00100000:0.0:1787380262.680783:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787380262.680790:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935527040:12345-0@lo:101: 00010000:00010000:0.0:1787380262.680798:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380262.680810:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842372 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.680831:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842372 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.680856:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842372 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.680876:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9680031a00, rc 0) 00000100:00100000:0.0:1787380262.681176:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935527040:12345-0@lo:101: Request processed in 385us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.681184:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787380262.681221:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527040:0@lo:101: 00010000:00010000:0.0:1787380262.681234:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380262.681243:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380262.681284:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527168:0@lo:501: 00000100:00100000:0.0:1787380262.681307:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380262.681321:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.681332:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527168 00000100:00100000:0.0:1787380262.681335:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527168 00000100:00100000:0.0:1787380262.681377:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787380262.681383:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935527168:12345-0@lo:501: 00000100:00100000:0.0:1787380262.681822:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935527168:12345-0@lo:501: Request processed in 437us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.681830:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787380262.682153:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527168:0@lo:501: 00000100:00100000:3.0:1787380262.682183:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527296:0@lo:503: 00000100:00100000:3.0:1787380262.682225:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.682291:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380262.683738:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527296 00000100:00100000:0.0:1787380262.683749:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527296 00000100:00100000:0.0:1787380262.683838:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380262.683847:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935527296:12345-0@lo:503: 00000100:00100000:0.0:1787380262.684073:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935527296:12345-0@lo:503: Request processed in 226us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.684089:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787380262.684168:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527296:0@lo:503: 00000100:00100000:3.0:1787380262.684676:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7755:1874203935527424:0@lo:502: 00000100:00100000:3.0:1787380262.684722:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.684762:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.684808:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527424 00000100:00100000:2.0:1787380262.684813:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527424 00000100:00100000:2.0:1787380262.684839:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787380262.684847:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:7755:x1874203935527424:12345-0@lo:502: 00000100:00100000:2.0:1787380262.685060:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:7755:x1874203935527424:12345-0@lo:502: Request processed in 212us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.685067:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787380262.685205:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7755:1874203935527424:0@lo:502: 00000100:00100000:3.0:1787380262.685263:0:7755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7755:1874203935527552:0@lo:502: 00000100:00100000:3.0:1787380262.685298:0:7755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.685319:0:7755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.685678:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527552 00000100:00100000:2.0:1787380262.685683:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527552 00000100:00100000:2.0:1787380262.685705:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787380262.685711:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:7755:x1874203935527552:12345-0@lo:502: 00000100:00100000:2.0:1787380262.685870:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:7755:x1874203935527552:12345-0@lo:502: Request processed in 158us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.685878:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787380262.685997:0:7755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7755:1874203935527552:0@lo:502: 00000040:00080000:3.0:1787380262.686019:0:7755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787380262.686156:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787380262.686174:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380262.686184:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.686195:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380262.686205:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787380262.686208:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d968b549800 from 5 10000000:01000000:2.0:1787380262.686211:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380262.686238:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.686247:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.686255:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380262.686267:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527680:0@lo:101: 00000100:00100000:2.0:1787380262.686293:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.686325:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.686403:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527680 00000100:00100000:3.0:1787380262.686408:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527680 00000100:00100000:3.0:1787380262.686429:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787380262.686435:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935527680:12345-0@lo:101: 00010000:00010000:3.0:1787380262.686444:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380262.686456:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163be00/0x651a07d118842387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.686474:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163be00/0x651a07d118842387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842380 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.686493:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163be00/0x651a07d118842387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842380 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.686513:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163be00, rc 0) 00000100:00100000:3.0:1787380262.686550:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935527680:12345-0@lo:101: Request processed in 115us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.686556:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787380262.686672:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527680:0@lo:101: 00010000:00010000:2.0:1787380262.686684:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.686692:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380262.686732:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527808:0@lo:256: 00000100:00100000:2.0:1787380262.686762:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.686786:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.686824:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527808 00000100:00100000:3.0:1787380262.686828:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527808 00000100:00100000:3.0:1787380262.686845:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787380262.686850:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935527808:12345-0@lo:256: 20000000:01000000:3.0:1787380262.686862:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787380262.686876:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787380262.686880:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787380262.686979:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935527808:12345-0@lo:256: Request processed in 128us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.686986:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787380262.687103:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527808:0@lo:256: 10000000:01000000:2.0:1787380262.687144:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380262.687151:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.687158:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380262.687165:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787380262.687167:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787380262.687170:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787380262.687185:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.687192:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.687200:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380262.687223:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527936:0@lo:101: 00000100:00100000:2.0:1787380262.687250:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.687273:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.687317:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935527936 00000100:00100000:3.0:1787380262.687321:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935527936 00000100:00100000:3.0:1787380262.687368:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787380262.687375:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935527936:12345-0@lo:101: 00010000:00010000:3.0:1787380262.687382:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380262.687392:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884238e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.687406:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884238e expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.687415:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884238e expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.687433:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b200, rc 0) 00000100:00100000:3.0:1787380262.687467:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935527936:12345-0@lo:101: Request processed in 92us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.687473:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787380262.687592:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935527936:0@lo:101: 00010000:00010000:2.0:1787380262.687602:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.687610:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380262.687649:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935528064:0@lo:501: 00000100:00100000:2.0:1787380262.687674:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.687687:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.687731:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528064 00000100:00100000:3.0:1787380262.687734:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528064 00000100:00100000:3.0:1787380262.687749:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787380262.687755:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935528064:12345-0@lo:501: 00000100:00100000:3.0:1787380262.688777:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935528064:12345-0@lo:501: Request processed in 1017us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.688787:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787380262.690082:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935528064:0@lo:501: 00000100:00100000:2.0:1787380262.690130:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935528192:0@lo:503: 00000100:00100000:2.0:1787380262.690183:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.690210:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf913c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.690228:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528192 00000100:00100000:2.0:1787380262.690232:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528192 00000100:00100000:2.0:1787380262.690267:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787380262.690274:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935528192:12345-0@lo:503: 00000100:00100000:2.0:1787380262.690612:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935528192:12345-0@lo:503: Request processed in 337us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.690619:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787380262.690663:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935528192:0@lo:503: 00000100:00100000:2.0:1787380262.690837:0:7756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7756:1874203935528320:0@lo:502: 00000100:00100000:2.0:1787380262.690868:0:7756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380262.691063:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528320 00000100:00100000:0.0:1787380262.691068:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528320 00000100:00100000:0.0:1787380262.691097:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787380262.691104:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:7756:x1874203935528320:12345-0@lo:502: 00000100:00100000:0.0:1787380262.698147:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:7756:x1874203935528320:12345-0@lo:502: Request processed in 7032us (7267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.698163:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787380262.698678:0:7756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.698706:0:7756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7756:1874203935528320:0@lo:502: 00000020:01000000:2.0:1787380262.698740:0:7756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380262.698747:0:7756:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787380262.698754:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380262.698756:0:7756:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787380262.698762:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787380262.698766:0:7756:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:2.0:1787380262.698787:0:7756:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787380262.698790:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380262.698804:0:7756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d9687733380) 00000020:00000080:2.0:1787380262.698825:0:7756:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787380262.698831:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787380262.698934:0:7756:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787380262.698939:0:7756:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787380262.698947:0:7756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d1188423a3 00010000:00080000:2.0:1787380262.698976:0:7756:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d9584a94000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:2.0:1787380262.699191:0:7756:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787380262.699537:0:7756:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787380262.699549:0:7756:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787380262.700056:0:7756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380262.700257:0:7756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380262.700309:0:7756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787380262.700391:0:7756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787380262.714574:0:7757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380262.714584:0:7757:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787380262.720422:0:7756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787380262.720437:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787380262.720469:0:7756:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787380262.720492:0:7756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d1188423aa 00000100:00080000:2.0:1787380262.720502:0:7756:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787380262.720508:0:7756:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d9584a94000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1787380262.720802:0:7756:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d96bd264a80 x1874203935528448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380262.720827:0:7756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787380262.721074:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935528576:0@lo:400: 00000100:00100000:2.0:1787380262.721133:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.721163:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380262.721169:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935528960:0@lo:400: 00000100:00100000:2.0:1787380262.721190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.721217:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935528832:0@lo:400: 00000100:00100000:2.0:1787380262.721243:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.721261:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380262.721267:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935528704:0@lo:400: 00000100:00100000:2.0:1787380262.721287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.721310:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528576 00000100:00100000:2.0:1787380262.721310:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528960 00000100:00100000:3.0:1787380262.721316:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528576 00000100:00100000:2.0:1787380262.721316:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528960 00000100:00100000:0.0:1787380262.721367:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935528448:0@lo:8: 00000100:00100000:0.0:1787380262.721399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380262.721421:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528832 00000100:00100000:1.0:1787380262.721425:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528832 00000100:00100000:1.0:1787380262.721468:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528448 00000100:00100000:1.0:1787380262.721472:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528448 00000100:00100000:1.0:1787380262.721485:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380262.721493:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935528832:12345-0@lo:400: 00000100:00100000:1.0:1787380262.721547:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935528832:12345-0@lo:400: Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380262.721560:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380262.721575:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380262.721579:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3298:x1874203935528448:12345-0@lo:8: 00010000:00080000:1.0:1787380262.721599:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1787380262.721637:0:6578:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d1188423b1 00002000:00100000:1.0:1787380262.721651:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d95851d6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787380262.721654:0:6578:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787380262.721658:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787380262.721768:0:6578:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380262.721904:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787380262.722006:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9d95851d2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380262.722050:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1874203935528448:12345-0@lo:8: Request processed in 468us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380262.722058:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787380262.722098:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd264a80 x1874203935528448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380262.722107:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380262.722114:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787380262.722120:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787380262.722125:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787380262.722127:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d9584a94000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787380262.722136:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787380262.722141:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935528448:0@lo:8: 00000004:00080000:0.0:1787380262.723306:0:7757:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787380262.723446:0:7757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 213035107280ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787380262.724000:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935528704 00000100:00100000:2.0:1787380262.724012:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935528704 00000100:00100000:3.0:1787380262.724022:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380262.724034:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935528960:12345-0@lo:400: 00000100:00100000:2.0:1787380262.724035:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787380262.724041:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1787380262.724089:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd265880 x1874203935528832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380262.724104:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935528832:0@lo:400: 00000100:00100000:2.0:1787380262.724220:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787380262.724229:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787380262.724235:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935528576:12345-0@lo:400: 00000100:00100000:3.0:1787380262.724329:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935528960:12345-0@lo:400: Request processed in 298us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.724352:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380262.724368:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787380262.724375:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380262.724382:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935528704:12345-0@lo:400: 00010000:00080000:0.0:1787380262.724383:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd264e00 x1874203935528960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380262.724395:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935528960:0@lo:400: 00000100:00100000:3.0:1787380262.724415:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935528704:12345-0@lo:400: Request processed in 33us (3126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.724421:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787380262.726280:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd267b80 x1874203935528704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380262.726296:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935528704:0@lo:400: 00000100:00100000:2.0:1787380262.726371:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935528576:12345-0@lo:400: Request processed in 2135us (5236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.726380:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787380262.726417:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd267480 x1874203935528576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380262.726430:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935528576:0@lo:400: 00000020:01000000:2.0:1787380262.726499:0:7756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380262.726505:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380262.726507:0:7756:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787380262.726512:0:7756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380262.730026:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380262.730032:0:7756:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380262.730049:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380262.730051:0:7756:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787380262.730093:0:7756:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7756:1874203935529088:0@lo:502: 00000100:00100000:3.0:1787380262.730162:0:7756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.730196:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529088 00000100:00100000:3.0:1787380262.730202:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529088 00000100:00100000:3.0:1787380262.730317:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787380262.730326:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:7756:x1874203935529088:12345-0@lo:502: 00000100:00100000:3.0:1787380262.730733:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:7756:x1874203935529088:12345-0@lo:502: Request processed in 406us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380262.730741:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787380262.730795:0:7756:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96894e8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.730817:0:7756:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:7756:1874203935529088:0@lo:502: 00000020:01000000:3.0:1787380262.730844:0:7756:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380262.730849:0:7756:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380262.730851:0:7756:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787380262.730854:0:7756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787380262.735084:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787380262.735120:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787380262.735131:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.735145:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380262.735155:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787380262.735157:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d9695a5b380 from 1 10000000:01000000:2.0:1787380262.735160:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787380262.735198:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.735206:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.735225:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380262.735248:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935529216:0@lo:101: 00000100:00100000:2.0:1787380262.735310:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.735363:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.735383:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529216 00000100:00100000:2.0:1787380262.735389:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529216 00000100:00100000:2.0:1787380262.735434:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787380262.735443:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935529216:12345-0@lo:101: 00010000:00010000:2.0:1787380262.735455:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380262.735466:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188423b8 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.735487:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188423b8 expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.735498:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188423b8 expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.735506:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c000, rc 0) 00000100:00100000:2.0:1787380262.735541:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935529216:12345-0@lo:101: Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380262.735548:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787380262.735611:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935529216:0@lo:101: 00010000:00010000:2.0:1787380262.735624:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380262.735643:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380262.735688:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935529344:0@lo:501: 00000100:00100000:2.0:1787380262.735714:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.735733:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.735744:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529344 00000100:00100000:2.0:1787380262.735747:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529344 00000100:00100000:2.0:1787380262.735767:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787380262.735772:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935529344:12345-0@lo:501: 00000100:00100000:2.0:1787380262.736228:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935529344:12345-0@lo:501: Request processed in 453us (510us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380262.736245:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787380262.737629:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935529344:0@lo:501: 10000000:01000000:3.0:1787380262.737668:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787380262.737676:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380262.737686:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380262.776228:0:7760:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787380262.776256:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935529472:0@lo:13: 00000100:00100000:0.0:1787380262.776256:0:7760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935529600:0@lo:7: 00000100:00100000:2.0:1787380262.776322:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380262.777218:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529472 00000100:00100000:0.0:1787380262.777228:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529472 00000100:00100000:0.0:1787380262.777290:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380262.777299:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874203935529472:12345-0@lo:13: 00002000:00000024:0.0:1787380262.777329:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787380262.777415:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874203935529472:12345-0@lo:13: Request processed in 117us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.777430:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787380262.777451:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787380262.778197:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e7b480 x1874203935529472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380262.778218:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935529472:0@lo:13: 00000100:00100000:0.0:1787380262.778304:0:7760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380262.778380:0:7760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380262.778429:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529600 00000100:00100000:1.0:1787380262.778436:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529600 00000100:00100000:1.0:1787380262.778478:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380262.778485:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7760:x1874203935529600:12345-0@lo:7: 00002000:00080000:1.0:1787380262.792980:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787380262.792989:0:6578:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787380262.793074:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7760:x1874203935529600:12345-0@lo:7: Request processed in 14585us (14766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380262.793087:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787380262.793218:0:7760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e78380 x1874203935529600/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787380278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380262.793234:0:7760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935529600:0@lo:7: 00000004:00080000:2.0:1787380262.793246:0:7760:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787380262.793284:0:7760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd265880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935529728:0@lo:5: 00000100:00100000:2.0:1787380262.793318:0:7760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.793379:0:7760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933fca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380262.793394:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529728 00000100:00100000:2.0:1787380262.793400:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529728 00000100:00100000:2.0:1787380262.793441:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380262.793457:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7760:x1874203935529728:12345-0@lo:5: 00002000:00080000:2.0:1787380262.793480:0:6576:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787380262.793484:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787380262.796089:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7760:x1874203935529728:12345-0@lo:5: Request processed in 2621us (2758us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787380262.796105:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787380262.796172:0:7760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd265880 x1874203935529728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380262.796187:0:7760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd265880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935529728:0@lo:5: 00000004:00080000:2.0:1787380262.796199:0:7760:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787380262.796235:0:7760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935529856:0@lo:700: 00000100:00100000:2.0:1787380262.796270:0:7760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380262.796300:0:7760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380262.796611:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529856 00000100:00100000:3.0:1787380262.797948:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529856 00000100:00100000:3.0:1787380262.798004:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380262.798011:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7760:x1874203935529856:12345-0@lo:700: 00000100:00100000:3.0:1787380262.798064:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6585:1874203935529984:0@lo:700: 00000100:00100000:3.0:1787380262.798113:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380262.798159:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9699161e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380262.798235:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935529984 00000100:00100000:1.0:1787380262.798240:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935529984 00000100:00100000:1.0:1787380262.798265:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380262.798271:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6585:x1874203935529984:12345-0@lo:700: 00000004:00080000:0.0:1787380262.840461:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1787380262.914785:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787380262.926720:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6585:x1874203935529984:12345-0@lo:700: Request processed in 128440us (128598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380262.926736:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787380262.927139:0:6585:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f34e00 x1874203935529984/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787380278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380262.927155:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6585:1874203935529984:0@lo:700: 40000000:02000000:3.0:1787380262.927168:0:6585:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1787380263.040003:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787380263.040018:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1787380263.041469:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7760:x1874203935529856:12345-0@lo:700: Request processed in 243451us (245192us total) trans 0 rc 0/0 00010000:00080000:2.0:1787380263.041478:0:7760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd264e00 x1874203935529856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787380278 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380263.041493:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380263.042041:0:7760:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787380263.042063:0:7760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935529856:0@lo:700: 00000004:02000040:0.0:1787380263.121636:0:7760:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787380263.128283:0:7760:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935530112:0@lo:5: 00000100:00100000:1.0:1787380263.128595:0:7760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380263.128648:0:7760:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380263.128710:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935530112 00000100:00100000:3.0:1787380263.128717:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935530112 00000100:00100000:3.0:1787380263.128765:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380263.128774:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7760:x1874203935530112:12345-0@lo:5: 00002000:00080000:3.0:1787380263.136158:0:6578:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787380263.136180:0:6578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787380263.140835:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7760:x1874203935530112:12345-0@lo:5: Request processed in 12055us (12234us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787380263.140848:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787380263.140991:0:7760:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd43e300 x1874203935530112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380279 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380263.141007:0:7760:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7760:1874203935530112:0@lo:5: 00000004:00080000:1.0:1787380263.141020:0:7760:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787380263.415489:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380264.023218:0:7828:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787380264.184663:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380264.184687:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935530240:0@lo:13: 00000100:00100000:1.0:1787380264.184751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380264.184867:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935530240 00000100:00100000:0.0:1787380264.184875:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935530240 00000100:00100000:0.0:1787380264.184951:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380264.184961:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935530240:12345-0@lo:13: 00002000:00000024:0.0:1787380264.184993:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380264.185042:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935530240:12345-0@lo:13: Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380264.185049:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787380264.185085:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e79880 x1874203935530240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380264.185102:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935530240:0@lo:13: 00000100:00080000:3.0:1787380264.185271:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787380264.439578:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380265.463658:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380266.489075:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380267.514924:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380267.768188:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935530368:0@lo:400: 00000100:00100000:0.0:1787380267.768256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380267.768302:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935530880:0@lo:400: 00000100:00100000:0.0:1787380267.768326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380267.768368:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380267.768373:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935530752:0@lo:400: 00000100:00100000:0.0:1787380267.768396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380267.768420:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935530496:0@lo:400: 00000100:00100000:0.0:1787380267.768440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380267.768453:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935531008:0@lo:400: 00000100:00100000:0.0:1787380267.768469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380267.768481:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380267.768485:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935530624:0@lo:400: 00000100:00100000:0.0:1787380267.768521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380267.768547:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935530752 00000100:00100000:0.0:1787380267.768554:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935530752 00000100:00100000:0.0:1787380267.768593:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531008 00000100:00100000:0.0:1787380267.768596:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531008 00000100:00100000:0.0:1787380267.768610:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380267.768617:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935530752:12345-0@lo:400: 00000100:00100000:0.0:1787380267.768659:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935530752:12345-0@lo:400: Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380267.768666:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380267.768680:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380267.768686:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935531008:12345-0@lo:400: 00000100:00100000:0.0:1787380267.768710:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935531008:12345-0@lo:400: Request processed in 24us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380267.768721:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380267.768737:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935530880 00000100:00100000:0.0:1787380267.768740:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935530880 00000100:00100000:0.0:1787380267.768761:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935530496 00000100:00100000:0.0:1787380267.768763:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935530496 00000100:00100000:0.0:1787380267.768771:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935530624 00000100:00100000:0.0:1787380267.768773:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935530624 00000100:00100000:0.0:1787380267.768784:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380267.768789:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935530880:12345-0@lo:400: 00000100:00100000:0.0:1787380267.768814:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935530880:12345-0@lo:400: Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380267.768820:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380267.768829:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787380267.768834:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935530496:12345-0@lo:400: 00000100:00100000:0.0:1787380267.768853:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935530496:12345-0@lo:400: Request processed in 19us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380267.768858:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787380267.768867:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380267.768872:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935530624:12345-0@lo:400: 00000100:00100000:0.0:1787380267.768910:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935530624:12345-0@lo:400: Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380267.768916:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787380267.768933:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380267.768936:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380267.768938:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787380267.768959:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f34a80 x1874203935530624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380267.768984:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935530624:0@lo:400: 00010000:00080000:0.0:1787380267.769008:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f37480 x1874203935530496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380267.769016:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935530496:0@lo:400: 00010000:00080000:0.0:1787380267.769024:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f37100 x1874203935531008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380267.769032:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935531008:0@lo:400: 00010000:00080000:0.0:1787380267.769059:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f35180 x1874203935530752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380267.769067:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935530752:0@lo:400: 00010000:00080000:0.0:1787380267.769075:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f35c00 x1874203935530880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380267.769083:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935530880:0@lo:400: 00000100:00100000:3.0:1787380267.769273:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935530368 00000100:00100000:3.0:1787380267.769278:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935530368 00000100:00100000:3.0:1787380267.769314:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787380267.769320:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935530368:12345-0@lo:400: 00000100:00100000:3.0:1787380267.769372:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935530368:12345-0@lo:400: Request processed in 53us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380267.769385:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787380267.770013:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935530368:0@lo:400: 00000100:00100000:0.0:1787380268.290811:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380268.290833:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935531136:0@lo:13: 00000100:00100000:0.0:1787380268.290908:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380268.290960:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531136 00000100:00100000:1.0:1787380268.290978:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531136 00000100:00100000:1.0:1787380268.291019:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380268.291027:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935531136:12345-0@lo:13: 00002000:00000024:1.0:1787380268.291067:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380268.291114:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935531136:12345-0@lo:13: Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380268.291120:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787380268.291125:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd43fb80 x1874203935531136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380268.291141:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935531136:0@lo:13: 00000001:00080000:1.0:1787380268.331946:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787380268.535757:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380269.318139:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935531264:0@lo:13: 00000100:00100000:0.0:1787380269.318238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380269.321462:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531264 00000100:00100000:3.0:1787380269.321476:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531264 00000100:00100000:3.0:1787380269.321532:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380269.321542:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935531264:12345-0@lo:13: 00002000:00000024:3.0:1787380269.321577:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380269.321649:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935531264:12345-0@lo:13: Request processed in 108us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.321656:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787380269.321979:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380269.322013:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd264e00 x1874203935531264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380269.322032:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935531264:0@lo:13: 00010000:00010000:3.0:1787380269.560825:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380269.668458:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380269.669722:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915583616 00000100:00100000:3.0:1787380269.669735:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915583616 00000100:00100000:3.0:1787380269.669793:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 112 00000100:00100000:3.0:1787380269.669803:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2352:x1874203915583616:12345-192.168.206.14@tcp:250: 00010000:00080000:3.0:1787380269.669831:0:5780:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 8a711699-f0d0-43cb-9af5-66a5d2b04101@192.168.206.14@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:3.0:1787380269.669859:0:5780:0:(genops.c:1406:class_connect()) connect: client 8a711699-f0d0-43cb-9af5-66a5d2b04101, cookie 0x651a07d1188423c6 00000100:00080000:3.0:1787380269.670017:0:5780:0:(import.c:65:import_set_state_nolock()) ffff9d95851fc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380269.670086:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+5:2352:x1874203915583616:12345-192.168.206.14@tcp:250: Request processed in 284us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.670095:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 112 00000100:00100000:3.0:1787380269.677501:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380269.677809:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915583744 00000100:00100000:0.0:1787380269.677822:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915583744 00000100:00100000:0.0:1787380269.677888:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 113 00000100:00100000:0.0:1787380269.677898:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+5:5556:x1874203915583744:12345-192.168.206.14@tcp:101: 00010000:00010000:0.0:1787380269.677912:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380269.677929:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f660e expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380269.677953:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380269.677962:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380269.677970:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9680031800, rc 0) 00000100:00100000:0.0:1787380269.678032:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+6:5556:x1874203915583744:12345-192.168.206.14@tcp:101: Request processed in 135us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.678038:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 113 00000100:00100000:2.0:1787380269.685420:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380269.685659:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915583872 00000100:00100000:3.0:1787380269.685681:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915583872 00000100:00100000:3.0:1787380269.685731:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 114 00000100:00100000:3.0:1787380269.685740:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+6:5556:x1874203915583872:12345-192.168.206.14@tcp:501: 00000100:00100000:3.0:1787380269.686064:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+6:5556:x1874203915583872:12345-192.168.206.14@tcp:501: Request processed in 323us (652us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380269.686072:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 114 00000100:00100000:1.0:1787380269.691911:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380269.691992:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584000 00000100:00100000:3.0:1787380269.692007:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584000 00000100:00100000:3.0:1787380269.692073:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 115 00000100:00100000:3.0:1787380269.692083:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+6:5556:x1874203915584000:12345-192.168.206.14@tcp:101: 00010000:00010000:3.0:1787380269.692099:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380269.692116:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6615 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380269.692144:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380269.692154:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380269.692162:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b600, rc 0) 00000100:00100000:3.0:1787380269.698270:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+7:5556:x1874203915584000:12345-192.168.206.14@tcp:101: Request processed in 6177us (6363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.698283:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 115 00000100:00100000:1.0:1787380269.713092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380269.713166:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584128 00000100:00100000:2.0:1787380269.713176:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584128 00000100:00100000:2.0:1787380269.713233:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 116 00000100:00100000:2.0:1787380269.713243:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+7:5556:x1874203915584128:12345-192.168.206.14@tcp:501: 00000100:00100000:2.0:1787380269.713534:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5556:x1874203915584128:12345-192.168.206.14@tcp:501: Request processed in 292us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380269.713542:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 116 00000100:00100000:0.0:1787380269.716685:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380269.716767:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584256 00000100:00100000:1.0:1787380269.716782:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584256 00000100:00100000:1.0:1787380269.716845:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 117 00000100:00100000:1.0:1787380269.716858:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5556:x1874203915584256:12345-192.168.206.14@tcp:503: 00000100:00100000:1.0:1787380269.717234:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5556:x1874203915584256:12345-192.168.206.14@tcp:503: Request processed in 377us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.717243:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 117 00000100:00100000:3.0:1787380269.721115:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380269.721756:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584384 00000100:00100000:0.0:1787380269.721771:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584384 00000100:00100000:0.0:1787380269.721929:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 118 00000100:00100000:0.0:1787380269.721942:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5574:x1874203915584384:12345-192.168.206.14@tcp:502: 00000100:00100000:0.0:1787380269.723698:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5574:x1874203915584384:12345-192.168.206.14@tcp:502: Request processed in 1745us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.723714:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 118 00000100:00100000:3.0:1787380269.772005:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380269.778990:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584512 00000100:00100000:0.0:1787380269.779003:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584512 00000100:00100000:0.0:1787380269.779065:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 119 00000100:00100000:0.0:1787380269.779074:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5574:x1874203915584512:12345-192.168.206.14@tcp:502: 00000100:00100000:0.0:1787380269.779371:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5574:x1874203915584512:12345-192.168.206.14@tcp:502: Request processed in 297us (7381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.779379:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 119 00000100:00100000:1.0:1787380269.790818:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380269.790872:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584640 00000100:00100000:1.0:1787380269.790897:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584640 00000100:00100000:1.0:1787380269.790960:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:1.0:1787380269.790971:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5556:x1874203915584640:12345-192.168.206.14@tcp:101: 00010000:00010000:1.0:1787380269.790993:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380269.791016:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96813f2800/0x651a07d1188423db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f663f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380269.791052:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96813f2800/0x651a07d1188423db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f663f expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380269.791095:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96813f2800/0x651a07d1188423db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f663f expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380269.791108:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96813f2800, rc 0) 00000100:00100000:1.0:1787380269.791180:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5556:x1874203915584640:12345-192.168.206.14@tcp:101: Request processed in 210us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.791188:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:2.0:1787380269.823549:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380269.823675:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584768 00000100:00100000:3.0:1787380269.823694:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584768 00000100:00100000:3.0:1787380269.824961:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 121 00000100:00100000:3.0:1787380269.824989:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5556:x1874203915584768:12345-192.168.206.14@tcp:256: 20000000:01000000:3.0:1787380269.825029:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787380269.825061:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787380269.825067:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787380269.825071:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787380269.825073:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787380269.829675:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5556:x1874203915584768:12345-192.168.206.14@tcp:256: Request processed in 4681us (6116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.829694:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 121 00000100:00100000:1.0:1787380269.838209:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380269.839365:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915584896 00000100:00100000:3.0:1787380269.839377:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915584896 00000100:00100000:3.0:1787380269.839431:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 122 00000100:00100000:3.0:1787380269.839441:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5556:x1874203915584896:12345-192.168.206.14@tcp:101: 00010000:00010000:3.0:1787380269.839458:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380269.839476:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6646 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380269.839504:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380269.839516:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380269.839743:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163a800, rc 0) 00000100:00100000:3.0:1787380269.839809:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5556:x1874203915584896:12345-192.168.206.14@tcp:101: Request processed in 369us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.839817:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 122 00000100:00100000:2.0:1787380269.860990:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380269.861227:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585024 00000100:00100000:1.0:1787380269.861240:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585024 00000100:00100000:1.0:1787380269.861303:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 123 00000100:00100000:1.0:1787380269.861313:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5556:x1874203915585024:12345-192.168.206.14@tcp:501: 00000100:00100000:1.0:1787380269.861605:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5556:x1874203915585024:12345-192.168.206.14@tcp:501: Request processed in 292us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.861613:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 123 00000100:00100000:1.0:1787380269.864390:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380269.865295:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585152 00000100:00100000:3.0:1787380269.865306:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585152 00000100:00100000:3.0:1787380269.865384:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 124 00000100:00100000:3.0:1787380269.865396:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5556:x1874203915585152:12345-192.168.206.14@tcp:503: 00000100:00100000:3.0:1787380269.865981:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5556:x1874203915585152:12345-192.168.206.14@tcp:503: Request processed in 586us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.865988:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 124 00000100:00100000:2.0:1787380269.871254:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380269.873830:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585280 00000100:00100000:1.0:1787380269.873842:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585280 00000100:00100000:1.0:1787380269.873918:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 125 00000100:00100000:1.0:1787380269.873928:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5579:x1874203915585280:12345-192.168.206.14@tcp:502: 00000100:00100000:1.0:1787380269.874188:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5579:x1874203915585280:12345-192.168.206.14@tcp:502: Request processed in 261us (2942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.874212:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 125 00000100:00100000:0.0:1787380269.882463:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380269.882627:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585408 00000100:00100000:1.0:1787380269.882640:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585408 00000100:00100000:1.0:1787380269.882726:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 126 00000100:00100000:1.0:1787380269.882737:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5579:x1874203915585408:12345-192.168.206.14@tcp:502: 00000100:00100000:1.0:1787380269.883052:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5579:x1874203915585408:12345-192.168.206.14@tcp:502: Request processed in 314us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.883060:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 126 00000100:00100000:1.0:1787380269.886617:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380269.886704:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585536 00000100:00100000:0.0:1787380269.886714:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585536 00000100:00100000:0.0:1787380269.886758:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:0.0:1787380269.886767:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1874203915585536:12345-192.168.206.14@tcp:38: 00010000:00080000:0.0:1787380269.886797:0:5788:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:0.0:1787380269.886841:0:5788:0:(genops.c:1406:class_connect()) connect: client 7dca2b77-2f7d-460b-a508-1b61c3cf2401, cookie 0x651a07d1188423e9 00000004:00100000:0.0:1787380269.886885:0:5788:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787380269.886891:0:5788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787380269.995923:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9d96bfd8b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380269.996007:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2352:x1874203915585536:12345-192.168.206.14@tcp:38: Request processed in 109238us (109397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.996020:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00010000:00010000:1.0:1787380270.583630:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380271.007779:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380271.007818:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380271.008016:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585664 00000100:00100000:2.0:1787380271.008025:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585664 00000100:00100000:2.0:1787380271.008101:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585792 00000100:00100000:2.0:1787380271.008105:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585792 00000100:00100000:2.0:1787380271.008126:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:2.0:1787380271.008135:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:0:x1874203915585664:12345-192.168.206.14@tcp:41: 00000004:00000024:2.0:1787380271.008175:0:7761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787380271.008274:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:0:x1874203915585664:12345-192.168.206.14@tcp:41: Request processed in 140us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380271.008282:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:2.0:1787380271.008298:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:2.0:1787380271.008305:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5556:x1874203915585792:12345-192.168.206.14@tcp:41: 00000004:00000024:2.0:1787380271.008315:0:7761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787380271.008333:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5556:x1874203915585792:12345-192.168.206.14@tcp:41: Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380271.008363:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00080000:0.0:1787380271.008428:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380271.012550:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380271.012920:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915585920 00000100:00100000:3.0:1787380271.012932:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915585920 00000100:00100000:3.0:1787380271.013060:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:3.0:1787380271.013079:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5556:x1874203915585920:12345-192.168.206.14@tcp:40: 00000100:00100000:3.0:1787380271.013186:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5556:x1874203915585920:12345-192.168.206.14@tcp:40: Request processed in 117us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380271.013194:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:1.0:1787380271.020791:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380271.020844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380271.020927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380271.020957:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380271.021037:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586304 00000100:00100000:2.0:1787380271.021051:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586304 00000100:00100000:2.0:1787380271.021117:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 127 00000100:00100000:2.0:1787380271.021128:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915586304:12345-192.168.206.14@tcp:400: 00000100:00100000:2.0:1787380271.021411:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915586304:12345-192.168.206.14@tcp:400: Request processed in 283us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380271.021421:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 127 00000100:00100000:0.0:1787380271.021640:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586048 00000100:00100000:0.0:1787380271.021646:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586048 00000100:00100000:0.0:1787380271.021678:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586176 00000100:00100000:0.0:1787380271.021681:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586176 00000100:00100000:0.0:1787380271.021694:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:0.0:1787380271.021700:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874203915586048:12345-192.168.206.14@tcp:8: 00010000:00080000:0.0:1787380271.021740:0:6577:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1787380271.022009:0:6577:0:(genops.c:1406:class_connect()) connect: client 7dca2b77-2f7d-460b-a508-1b61c3cf2401, cookie 0x651a07d1188423f0 00002000:00100000:0.0:1787380271.022026:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7dca2b77-2f7d-460b-a508-1b61c3cf2401/ffff9d96bfd8f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787380271.022055:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787380271.022818:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787380271.022861:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9d96bfd8d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380271.022951:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2352:x1874203915586048:12345-192.168.206.14@tcp:8: Request processed in 1248us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380271.022961:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:0.0:1787380271.022991:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:0.0:1787380271.022997:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874203915586176:12345-192.168.206.14@tcp:8: 00010000:00080000:0.0:1787380271.023023:0:6577:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1787380271.023047:0:6577:0:(genops.c:1406:class_connect()) connect: client 7dca2b77-2f7d-460b-a508-1b61c3cf2401, cookie 0x651a07d1188423f7 00002000:00100000:0.0:1787380271.023054:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7dca2b77-2f7d-460b-a508-1b61c3cf2401/ffff9d96bfd8c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787380271.023072:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787380271.024483:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787380271.024529:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9d96bfd8e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380271.024607:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2352:x1874203915586176:12345-192.168.206.14@tcp:8: Request processed in 1607us (3648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380271.024974:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:2.0:1787380271.025504:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586432 00000100:00100000:2.0:1787380271.025515:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586432 00000100:00100000:2.0:1787380271.025625:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:2.0:1787380271.025636:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5556:x1874203915586432:12345-192.168.206.14@tcp:33: 00000004:00080000:1.0:1787380271.052097:0:5789:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26381us 00000004:00200000:0.0:1787380271.060495:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787380271.060757:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5556:x1874203915586432:12345-192.168.206.14@tcp:33: Request processed in 35037us (39826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380271.060772:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1787380271.304604:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380271.304699:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586560 00000100:00100000:3.0:1787380271.304709:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586560 00000100:00100000:3.0:1787380271.304814:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:3.0:1787380271.304825:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5596:x1874203915586560:12345-192.168.206.14@tcp:101: 00010000:00010000:3.0:1787380271.304852:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380271.304921:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188423fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6670 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380271.304998:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842405 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380271.305013:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380271.305044:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380271.305251:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787380271.305255:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380271.305324:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380271.305375:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188423fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6670 expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380271.305391:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842405 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6670 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380271.305398:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727ff00) 00010000:00010000:3.0:1787380271.305401:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380271.305405:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54c00, rc 0) 00000100:00100000:3.0:1787380271.305463:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:5596:x1874203915586560:12345-192.168.206.14@tcp:101: Request processed in 640us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380271.305471:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00010000:00010000:3.0:1787380271.608770:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380272.633184:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380272.888250:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935531520:0@lo:400: 00000100:00100000:2.0:1787380272.888321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380272.888493:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380272.888509:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935531392:0@lo:400: 00000100:00100000:3.0:1787380272.888547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380272.888592:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935531648:0@lo:400: 00000100:00100000:3.0:1787380272.888616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380272.888662:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531520 00000100:00100000:3.0:1787380272.888676:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531520 00000100:00100000:3.0:1787380272.888718:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531648 00000100:00100000:3.0:1787380272.888722:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531648 00000100:00100000:3.0:1787380272.888750:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380272.888757:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935531520:12345-0@lo:400: 00000100:00100000:0.0:1787380272.888932:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531392 00000100:00100000:0.0:1787380272.888937:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531392 00000100:00100000:0.0:1787380272.888966:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787380272.888974:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935531392:12345-0@lo:400: 00000100:00100000:0.0:1787380272.889013:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935531392:12345-0@lo:400: Request processed in 40us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380272.889020:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1787380272.889051:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380272.889062:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787380272.889069:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935531648:12345-0@lo:400: 00000100:00100000:0.0:1787380272.889112:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935531648:12345-0@lo:400: Request processed in 44us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380272.889118:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787380272.889159:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935531648:0@lo:400: 00000100:00100000:0.0:1787380272.889198:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935531392:0@lo:400: 00000100:00100000:3.0:1787380272.893981:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935531520:12345-0@lo:400: Request processed in 5214us (5650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380272.893996:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787380272.894628:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935531520:0@lo:400: 00000100:00100000:2.0:1787380272.894657:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935532032:0@lo:400: 00000100:00100000:2.0:1787380272.894712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380272.896250:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532032 00000100:00100000:3.0:1787380272.896263:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532032 00000100:00100000:3.0:1787380272.896372:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380272.896388:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935532032:12345-0@lo:400: 00000100:00100000:3.0:1787380272.896472:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935532032:12345-0@lo:400: Request processed in 91us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380272.896479:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787380272.896550:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce9f80 x1874203935532032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380272.896561:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787380272.896577:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935532032:0@lo:400: 00000100:00100000:0.0:1787380272.896930:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935531776:0@lo:400: 00000100:00100000:0.0:1787380272.896979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380272.897025:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380272.897032:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935531904:0@lo:400: 00000100:00100000:0.0:1787380272.897066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380272.897095:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531904 00000100:00100000:0.0:1787380272.897099:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531904 00000100:00100000:0.0:1787380272.897136:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787380272.897144:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935531904:12345-0@lo:400: 00000100:00100000:0.0:1787380272.897184:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935531904:12345-0@lo:400: Request processed in 41us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380272.897202:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787380272.897236:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698cead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935531904:0@lo:400: 00000100:00100000:3.0:1787380272.897363:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935531776 00000100:00100000:3.0:1787380272.897367:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935531776 00000100:00100000:3.0:1787380272.897407:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380272.897415:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935531776:12345-0@lo:400: 00000100:00100000:3.0:1787380272.897472:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935531776:12345-0@lo:400: Request processed in 57us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380272.897478:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787380272.897506:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce9500 x1874203935531776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380272.897523:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935531776:0@lo:400: 00000100:00080000:2.0:1787380272.898324:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380272.898331:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380272.898334:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380273.400261:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380273.400295:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935532160:0@lo:13: 00000100:00100000:0.0:1787380273.400390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380273.400731:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532160 00000100:00100000:1.0:1787380273.400739:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532160 00000100:00100000:1.0:1787380273.400791:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380273.400800:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935532160:12345-0@lo:13: 00002000:00000024:1.0:1787380273.400832:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380273.400896:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935532160:12345-0@lo:13: Request processed in 97us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380273.400903:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787380273.401000:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698cea300 x1874203935532160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380273.401017:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935532160:0@lo:13: 00000100:00100000:0.0:1787380273.621988:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380273.622105:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586688 00000100:00100000:3.0:1787380273.622115:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586688 00000100:00100000:3.0:1787380273.622204:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:3.0:1787380273.622215:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:5649:x1874203915586688:12345-192.168.206.14@tcp:41: 00000004:00000024:3.0:1787380273.622257:0:5787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787380273.622329:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:5649:x1874203915586688:12345-192.168.206.14@tcp:41: Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380273.622372:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00080000:2.0:1787380273.622449:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380273.639062:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380273.639229:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586816 00000100:00100000:3.0:1787380273.639243:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586816 00000100:00100000:3.0:1787380273.639374:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:3.0:1787380273.639387:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5649:x1874203915586816:12345-192.168.206.14@tcp:13: 00002000:00000024:3.0:1787380273.639438:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380273.639527:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5649:x1874203915586816:12345-192.168.206.14@tcp:13: Request processed in 143us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380273.639535:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00080000:2.0:1787380273.639616:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380273.651180:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380273.651417:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915586944 00000100:00100000:3.0:1787380273.651429:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915586944 00000100:00100000:3.0:1787380273.651519:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1787380273.651532:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5649:x1874203915586944:12345-192.168.206.14@tcp:13: 00002000:00000024:3.0:1787380273.651573:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380273.651653:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:5649:x1874203915586944:12345-192.168.206.14@tcp:13: Request processed in 123us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380273.651661:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00080000:2.0:1787380273.651804:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787380273.655741:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380274.437464:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380274.437498:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935532288:0@lo:13: 00000100:00100000:2.0:1787380274.437589:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380274.437666:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532288 00000100:00100000:2.0:1787380274.437676:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532288 00000100:00100000:2.0:1787380274.437742:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380274.437753:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935532288:12345-0@lo:13: 00002000:00000024:2.0:1787380274.437781:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380274.437827:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935532288:12345-0@lo:13: Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380274.437846:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787380274.437881:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787380274.437918:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd266d80 x1874203935532288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380274.437939:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935532288:0@lo:13: 00010000:00010000:1.0:1787380274.681446:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787380275.025403:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000001:00100000:1.0:1787380275.582820:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00010000:00010000:3.0:1787380275.703605:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787380276.012005:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000100:00100000:2.0:1787380276.082218:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380276.082262:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380276.082304:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380276.082334:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380276.082378:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587200 00000100:00100000:2.0:1787380276.082387:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587200 00000100:00100000:2.0:1787380276.082454:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:2.0:1787380276.082466:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915587200:12345-192.168.206.14@tcp:400: 00000100:00100000:2.0:1787380276.082539:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915587200:12345-192.168.206.14@tcp:400: Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380276.082548:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00080000:2.0:1787380276.082584:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380276.082621:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587328 00000100:00100000:2.0:1787380276.082625:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587328 00000100:00100000:2.0:1787380276.082652:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587456 00000100:00100000:2.0:1787380276.082655:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587456 00000100:00100000:2.0:1787380276.082670:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:2.0:1787380276.082676:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915587328:12345-192.168.206.14@tcp:400: 00000100:00100000:2.0:1787380276.082705:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915587328:12345-192.168.206.14@tcp:400: Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380276.082712:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:2.0:1787380276.082736:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:2.0:1787380276.082742:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915587456:12345-192.168.206.14@tcp:400: 00000100:00100000:2.0:1787380276.082768:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915587456:12345-192.168.206.14@tcp:400: Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380276.082774:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00080000:2.0:1787380276.082790:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380276.082792:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380276.085485:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587072 00000100:00100000:2.0:1787380276.085498:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587072 00000100:00100000:2.0:1787380276.085550:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 129 00000100:00100000:2.0:1787380276.085560:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915587072:12345-192.168.206.14@tcp:400: 00000100:00100000:2.0:1787380276.085621:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915587072:12345-192.168.206.14@tcp:400: Request processed in 63us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380276.085628:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 129 00000001:02000400:3.0:1787380276.446308:0:8138:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787380276.727461:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380277.755145:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380278.008406:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935532544:0@lo:400: 00000100:00100000:1.0:1787380278.008471:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380278.008516:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935533056:0@lo:400: 00000100:00100000:1.0:1787380278.008559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380278.008589:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380278.008595:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935532672:0@lo:400: 00000100:00100000:1.0:1787380278.008623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380278.008656:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532544 00000100:00100000:1.0:1787380278.008663:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532544 00000100:00100000:0.0:1787380278.008698:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935532800:0@lo:400: 00000100:00100000:1.0:1787380278.008704:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532672 00000100:00100000:1.0:1787380278.008707:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532672 00000100:00100000:0.0:1787380278.008727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380278.008734:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380278.008741:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935532544:12345-0@lo:400: 00000100:00100000:0.0:1787380278.008745:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787380278.008749:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935532416:0@lo:400: 00000100:00100000:1.0:1787380278.015625:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935532544:12345-0@lo:400: Request processed in 6873us (7143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380278.015640:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380278.015675:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380278.015699:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935532672:12345-0@lo:400: 00000100:00100000:1.0:1787380278.015747:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935532672:12345-0@lo:400: Request processed in 55us (7124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380278.015753:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380278.015780:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935533056 00000100:00100000:1.0:1787380278.015787:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935533056 00000100:00100000:1.0:1787380278.015839:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532800 00000100:00100000:1.0:1787380278.015856:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532800 00000100:00100000:1.0:1787380278.015877:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380278.015883:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935533056:12345-0@lo:400: 00000100:00100000:1.0:1787380278.015916:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935533056:12345-0@lo:400: Request processed in 33us (7357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380278.015921:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380278.015931:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380278.015937:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935532800:12345-0@lo:400: 00000100:00100000:1.0:1787380278.015965:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935532800:12345-0@lo:400: Request processed in 29us (7237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380278.015970:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787380278.015989:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380278.015993:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380278.015995:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380278.016031:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935532672:0@lo:400: 00000100:00100000:1.0:1787380278.016044:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935532544:0@lo:400: 00010000:00080000:1.0:1787380278.016057:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce9c00 x1874203935533056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380278.016066:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935533056:0@lo:400: 00000100:00100000:0.0:1787380278.022162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380278.022239:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935532928:0@lo:400: 00000100:00100000:0.0:1787380278.022307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380278.022359:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532928 00000100:00100000:0.0:1787380278.022366:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532928 00000100:00100000:0.0:1787380278.022423:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787380278.022431:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935532928:12345-0@lo:400: 00000100:00100000:0.0:1787380278.022477:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935532928:12345-0@lo:400: Request processed in 48us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380278.022484:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787380278.022505:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380278.022529:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935532928:0@lo:400: 00010000:00080000:0.0:1787380278.022544:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce8e00 x1874203935532800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380278.022554:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935532800:0@lo:400: 00000100:00100000:1.0:1787380278.023654:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935532416 00000100:00100000:1.0:1787380278.023663:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935532416 00000100:00100000:1.0:1787380278.023718:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787380278.023726:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935532416:12345-0@lo:400: 00000100:00100000:1.0:1787380278.023786:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935532416:12345-0@lo:400: Request processed in 61us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380278.023793:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787380278.026877:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935532416:0@lo:400: 00000100:00100000:1.0:1787380278.521818:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380278.521856:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935533184:0@lo:13: 00000100:00100000:1.0:1787380278.521921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380278.521987:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935533184 00000100:00100000:1.0:1787380278.521994:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935533184 00000100:00100000:1.0:1787380278.522037:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380278.522046:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935533184:12345-0@lo:13: 00002000:00000024:1.0:1787380278.522079:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380278.522125:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935533184:12345-0@lo:13: Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380278.522132:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787380278.522170:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce9c00 x1874203935533184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380278.522187:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935533184:0@lo:13: 00010000:00010000:1.0:1787380278.775607:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380279.543618:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935533312:0@lo:13: 00000100:00100000:0.0:1787380279.543701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380279.544017:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935533312 00000100:00100000:1.0:1787380279.544035:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935533312 00000100:00100000:1.0:1787380279.544087:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787380279.544096:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935533312:12345-0@lo:13: 00002000:00000024:1.0:1787380279.544131:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380279.544180:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935533312:12345-0@lo:13: Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380279.544187:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787380279.544490:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd264700 x1874203935533312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380279.544509:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935533312:0@lo:13: 00010000:00010000:0.0:1787380279.803093:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787380280.477604:0:8286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc7e4eb150 00000020:00000080:2.0:1787380280.477619:0:8286:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787380280.477624:0:8286:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787380280.477631:0:8286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7e4ed3e0 20000000:00000080:2.0:1787380280.477637:0:8286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d96b5e5d400 uarg=0000000000000000 20000000:01000000:2.0:1787380280.477669:0:8286:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787380280.477671:0:8286:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787380280.477674:0:8286:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787380280.477722:0:8286:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787380280.477727:0:8286:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787380280.477740:0:8286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787380280.477742:0:8286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787380280.478138:0:8286:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787380280.478142:0:8286:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380280.479193:0:8287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787380280.479863:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787380280.480874:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787380280.481518:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787380280.481538:0:8286:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787380280.481541:0:8286:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380280.482591:0:8288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787380280.483178:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787380280.483227:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787380280.483543:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787380280.483559:0:8286:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787380280.483561:0:8286:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380280.484525:0:8289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787380280.485159:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787380280.485223:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787380280.485334:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787380280.485541:0:8286:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787380280.485543:0:8286:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380280.486539:0:8290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787380280.487160:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787380280.487208:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787380280.487245:0:8286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1787380280.487513:0:8286:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787380280.487533:0:8286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487551:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842302 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487558:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884232c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487564:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842356 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487570:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842364 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487588:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842372 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487594:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884238e expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487600:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188423b8 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487609:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487617:0:8286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487624:0:8286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487660:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487673:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 9 pid: 5780 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.487698:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533440:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380280.487798:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487807:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 9 pid: 5779 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.487834:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533568:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380280.487869:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188423b8 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.487889:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188423b8 expref: 18 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.487898:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533696:0@lo:104: 00000100:00100000:3.0:1787380280.487947:0:8286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380280.488137:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d11884238e expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.488146:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d11884238e expref: 18 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.488155:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533824:0@lo:104: 00000100:00100000:3.0:1787380280.488176:0:8286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380280.492211:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842372 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.492230:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842372 expref: 18 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.492245:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533952:0@lo:104: 00010000:00010000:3.0:1787380280.492309:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842364 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.492317:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842364 expref: 18 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.492355:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534080:0@lo:104: 00010000:00010000:3.0:1787380280.492384:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842356 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.492392:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842356 expref: 18 pid: 5779 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.492400:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534208:0@lo:104: 00010000:00010000:3.0:1787380280.492436:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d11884232c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.492444:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d11884232c expref: 18 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.492452:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534336:0@lo:104: 00010000:00010000:3.0:1787380280.492474:0:8286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842302 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.492482:0:8286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842302 expref: 18 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.492489:0:8286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534464:0@lo:104: 00000100:00100000:3.0:1787380280.492503:0:8286:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380280.495002:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380280.495030:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380280.495178:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587584 00000100:00100000:0.0:1787380280.495185:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587584 00010000:00010000:0.0:1787380280.495218:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 10 pid: 5780 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.495250:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587712 00000100:00100000:0.0:1787380280.495261:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587712 00010000:00010000:0.0:1787380280.495271:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 11 pid: 5779 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.495284:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:0.0:1787380280.495290:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2355:x1874203915587584:12345-192.168.206.14@tcp:103: 00010000:00010000:0.0:1787380280.495302:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380280.495307:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 11 pid: 5780 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380280.495317:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 11 pid: 5780 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380280.495334:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380280.495407:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2355:x1874203915587584:12345-192.168.206.14@tcp:103: Request processed in 116us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380280.495414:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:0.0:1787380280.495428:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:0.0:1787380280.495433:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915587712:12345-192.168.206.14@tcp:103: 00010000:00010000:0.0:1787380280.495439:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380280.495442:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 10 pid: 5779 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380280.495450:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 10 pid: 5779 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380280.495459:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380280.495475:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915587712:12345-192.168.206.14@tcp:103: Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380280.495481:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00010000:00010000:0.0:1787380280.495539:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b600/0x651a07d1188423d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6615 expref: 9 pid: 5780 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.495553:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533440:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380280.495564:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680031800/0x651a07d1188423cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f660e expref: 8 pid: 5779 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.495585:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533568:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380280.496136:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787380280.496178:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380280.496197:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380280.496207:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380280.496216:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380280.496225:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380280.496233:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935533696 00000100:00100000:1.0:1787380280.496237:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935533696 00000100:00100000:1.0:1787380280.496656:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935533824 00000100:00100000:1.0:1787380280.496661:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935533824 00000100:00100000:1.0:1787380280.496676:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935533952 00000100:00100000:1.0:1787380280.496678:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935533952 00000100:00100000:1.0:1787380280.496686:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534080 00000100:00100000:1.0:1787380280.496688:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534080 00000100:00100000:1.0:1787380280.496697:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534208 00000100:00100000:1.0:1787380280.496699:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534208 00000100:00100000:1.0:1787380280.496708:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534336 00000100:00100000:1.0:1787380280.496710:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534336 00000100:00100000:1.0:1787380280.496718:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534464 00000100:00100000:1.0:1787380280.496720:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534464 00000100:00100000:1.0:1787380280.496734:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380280.496740:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:8286:x1874203935533696:12345-0@lo:104: 00010000:00010000:1.0:1787380280.496752:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380280.496826:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380280.496832:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+9:8286:x1874203935533696:12345-0@lo:104: Request processed in 93us (8886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380280.496839:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380280.496853:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380280.496859:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd259c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+8:8286:x1874203935533824:12345-0@lo:104: 00010000:00010000:1.0:1787380280.496866:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380280.496918:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787380280.496924:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd259c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+8:8286:x1874203935533824:12345-0@lo:104: Request processed in 65us (8747us total) trans 0 rc 0/0 00010000:00010000:3.0:1787380280.497028:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380280.497035:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497048:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380280.497052:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497060:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380280.497066:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380280.497072:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380280.497103:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497109:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380280.497124:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497130:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d1188423b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188423bf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497143:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380280.497146:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497152:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380280.497154:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497182:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380280.497188:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380280.497194:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380280.497208:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497214:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380280.497234:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497241:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216d000/0x651a07d11884238e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842395 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497251:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.497253:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.497264:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380280.497284:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935534592:0@lo:103: 00000100:00100000:3.0:1787380280.497314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380280.497375:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534592 00000100:00100000:3.0:1787380280.497379:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534592 00010000:00010000:3.0:1787380280.497395:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188423b8 expref: 19 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.497415:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380280.497421:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935534592:12345-0@lo:103: 00010000:00010000:3.0:1787380280.497437:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380280.497442:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188423b8 expref: 19 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497452:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188423b8 expref: 19 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.497464:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380280.497493:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935534592:12345-0@lo:103: Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380280.497499:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380280.497533:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935534592:0@lo:103: 00010000:00010000:0.0:1787380280.497888:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216c000/0x651a07d1188423bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188423b8 expref: 18 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.497899:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533696:0@lo:104: 00000100:00100000:0.0:1787380280.497915:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533824:0@lo:104: 00000100:00100000:1.0:1787380280.498084:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380280.498114:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787380280.498121:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+7:8286:x1874203935533952:12345-0@lo:104: 00010000:00010000:1.0:1787380280.498130:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380280.498261:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380280.498266:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+7:8286:x1874203935533952:12345-0@lo:104: Request processed in 147us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380280.498272:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787380280.498284:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380280.498290:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:8286:x1874203935534080:12345-0@lo:104: 00010000:00010000:1.0:1787380280.498297:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.498331:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380280.498350:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.498356:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9680030000 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380280.498360:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.498367:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380280.498373:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380280.498377:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380280.498398:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.498413:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380280.498421:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.498427:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9680030000/0x651a07d118842372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842379 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.498448:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.498450:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.498451:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380280.499401:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1787380280.499409:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787380280.499427:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935534848:0@lo:103: 00000100:00100000:3.0:1787380280.500419:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1787380280.501461:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935533952:0@lo:104: 00010000:00010000:1.0:1787380280.501696:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380280.501705:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+6:8286:x1874203935534080:12345-0@lo:104: Request processed in 3414us (5505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380280.501714:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380280.501745:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787380280.501756:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:8286:x1874203935534208:12345-0@lo:104: 00010000:00010000:1.0:1787380280.501773:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.501861:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534080:0@lo:104: 00000100:00100000:0.0:1787380280.501871:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534208:0@lo:104: 00000100:00100000:2.0:1787380280.502057:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380280.502098:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380280.502109:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935534720:0@lo:103: 00000100:00100000:2.0:1787380280.502134:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380280.502490:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534848 00000100:00100000:2.0:1787380280.502498:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534848 00010000:00010000:2.0:1787380280.502531:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842372 expref: 18 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380280.502548:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534720 00000100:00100000:2.0:1787380280.502551:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534720 00010000:00010000:2.0:1787380280.502561:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884238e expref: 19 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380280.502571:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380280.502577:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935534848:12345-0@lo:103: 00010000:00010000:2.0:1787380280.502586:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380280.502591:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842372 expref: 19 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380280.502601:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842372 expref: 19 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380280.502624:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9680031a00/0x651a07d118842379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842372 expref: 19 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380280.502639:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380280.502671:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:3302:x1874203935534848:12345-0@lo:103: Request processed in 94us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380280.502677:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380280.502693:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787380280.502700:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:3302:x1874203935534720:12345-0@lo:103: 00010000:00010000:2.0:1787380280.502707:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380280.502711:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884238e expref: 17 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380280.502720:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d11884238e expref: 17 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380280.502730:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b200/0x651a07d118842395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d11884238e expref: 17 pid: 5780 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380280.502739:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380280.502757:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3302:x1874203935534720:12345-0@lo:103: Request processed in 59us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380280.502763:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787380280.502788:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935534720:0@lo:103: 00000100:00100000:2.0:1787380280.502796:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935534848:0@lo:103: 00010000:00010000:3.0:1787380280.502870:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380280.502887:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.502895:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163ba00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380280.502900:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.502909:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380280.502916:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380280.502922:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380280.502966:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.502973:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380280.503001:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503008:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163ba00/0x651a07d118842364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884236b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503030:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380280.503033:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503047:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f3600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380280.503050:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503057:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380280.503063:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380280.503069:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380280.503083:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503089:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380280.503094:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503100:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f3600/0x651a07d118842356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884235d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503109:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.503116:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.503118:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380280.503130:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935534976:0@lo:103: 00000100:00100000:3.0:1787380280.503159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380280.503537:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380280.503544:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935535104:0@lo:103: 00000100:00100000:3.0:1787380280.503571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380280.503602:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935534976 00000100:00100000:3.0:1787380280.503606:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935534976 00010000:00010000:3.0:1787380280.503624:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842364 expref: 16 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.503639:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935535104 00000100:00100000:3.0:1787380280.503641:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935535104 00010000:00010000:3.0:1787380280.503651:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842356 expref: 17 pid: 5779 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.503663:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380280.503669:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:3299:x1874203935534976:12345-0@lo:103: 00010000:00010000:3.0:1787380280.503677:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787380280.503815:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787380280.503833:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787380280.503869:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842364 expref: 17 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503879:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842364 expref: 17 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503892:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216d800/0x651a07d11884236b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842364 expref: 17 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.503904:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380280.504055:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3299:x1874203935534976:12345-0@lo:103: Request processed in 385us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380280.504063:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380280.504078:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380280.504084:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:3299:x1874203935535104:12345-0@lo:103: 00010000:00010000:3.0:1787380280.504092:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380280.504097:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842356 expref: 15 pid: 5779 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.504105:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842356 expref: 15 pid: 5779 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.504115:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216de00/0x651a07d11884235d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842356 expref: 15 pid: 5779 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.504123:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380280.504143:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:3299:x1874203935535104:12345-0@lo:103: Request processed in 60us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380280.504148:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787380280.504729:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787380280.504738:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:8286:x1874203935534208:12345-0@lo:104: Request processed in 2986us (8529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380280.504746:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787380280.504764:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380280.504772:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:8286:x1874203935534336:12345-0@lo:104: 00010000:00010000:1.0:1787380280.504783:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380280.504881:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380280.504887:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:8286:x1874203935534336:12345-0@lo:104: Request processed in 118us (8669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380280.504893:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380280.504905:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787380280.504912:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:8286:x1874203935534464:12345-0@lo:104: 00010000:00010000:1.0:1787380280.504919:0:5769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380280.504954:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787380280.504959:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:8286:x1874203935534464:12345-0@lo:104: Request processed in 48us (8733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380280.504964:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787380280.505194:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380280.505201:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505209:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9680030400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380280.505214:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505222:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380280.505243:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380280.505249:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380280.505291:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505298:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380280.505310:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505317:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9680030400/0x651a07d11884232c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842333 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505330:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380280.505333:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505367:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ce00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380280.505371:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505378:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380280.505385:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380280.505391:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380280.505410:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505415:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380280.505421:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505426:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d118842302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842309 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505440:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.505442:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380280.505443:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380280.505456:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935535360:0@lo:103: 00000100:00100000:3.0:1787380280.505488:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380280.505518:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380280.505524:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935535232:0@lo:103: 00000100:00100000:3.0:1787380280.505544:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380280.505577:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935535360 00000100:00100000:3.0:1787380280.505583:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935535360 00010000:00010000:3.0:1787380280.505603:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842302 expref: 14 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.505616:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935535232 00000100:00100000:3.0:1787380280.505619:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935535232 00010000:00010000:3.0:1787380280.505628:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884232c expref: 15 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380280.505638:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787380280.505644:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:3302:x1874203935535360:12345-0@lo:103: 00010000:00010000:3.0:1787380280.505661:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380280.505666:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842302 expref: 15 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505674:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842302 expref: 15 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505686:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380280.505714:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:3302:x1874203935535360:12345-0@lo:103: Request processed in 70us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380280.505720:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787380280.505733:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787380280.505738:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:3302:x1874203935535232:12345-0@lo:103: 00010000:00010000:3.0:1787380280.505745:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380280.505749:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884232c expref: 14 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505758:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d11884232c expref: 14 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505770:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505777:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505790:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505797:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505810:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505827:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505833:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55c00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380280.505837:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505845:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505853:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.505863:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380280.505899:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:3302:x1874203935535232:12345-0@lo:103: Request processed in 160us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380280.505905:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787380280.506327:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935535232:0@lo:103: 00000100:00100000:3.0:1787380280.506355:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935535360:0@lo:103: 00010000:00010000:1.0:1787380280.506524:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380280.507872:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935534976:0@lo:103: 00000100:00100000:2.0:1787380280.508016:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935535104:0@lo:103: 00010000:00010000:0.0:1787380280.512804:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b400/0x651a07d118842333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d11884232c expref: 13 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.512839:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534336:0@lo:104: 00010000:00010000:0.0:1787380280.512855:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216c800/0x651a07d118842309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842302 expref: 12 pid: 5781 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380280.512867:0:8286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8286:1874203935534464:0@lo:104: 00010000:00010000:0.0:1787380280.512919:0:8286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380280.512937:0:8286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380280.512943:0:8286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380280.512949:0:8286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af55c00/0x651a07d11884240c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380280.826894:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380281.202110:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380281.202374:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380281.202473:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380281.202555:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587968 00000100:00100000:0.0:1787380281.202564:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587968 00000100:00100000:0.0:1787380281.202627:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588096 00000100:00100000:0.0:1787380281.202630:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588096 00000100:00100000:0.0:1787380281.202648:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:0.0:1787380281.202669:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915587968:12345-192.168.206.14@tcp:400: 00000100:00100000:0.0:1787380281.202741:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915587968:12345-192.168.206.14@tcp:400: Request processed in 74us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380281.202748:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:0.0:1787380281.202763:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:0.0:1787380281.202769:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915588096:12345-192.168.206.14@tcp:400: 00000100:00100000:0.0:1787380281.202790:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915588096:12345-192.168.206.14@tcp:400: Request processed in 22us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380281.202796:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00080000:3.0:1787380281.204382:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380281.204399:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380281.205795:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915587840 00000100:00100000:2.0:1787380281.205810:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915587840 00000100:00100000:2.0:1787380281.205906:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:2.0:1787380281.205916:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915587840:12345-192.168.206.14@tcp:400: 00000100:00100000:2.0:1787380281.206069:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915587840:12345-192.168.206.14@tcp:400: Request processed in 154us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380281.206077:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00080000:3.0:1787380281.206222:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787380281.847557:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380281.978240:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787380281.978248:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d969f0ea800 from 39 10000000:01000000:3.0:1787380281.978254:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787380281.978307:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380281.978319:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380281.978331:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380281.978373:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935535488:0@lo:101: 00000100:00100000:3.0:1787380281.978446:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.978514:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380281.979321:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935535488 00000100:00100000:2.0:1787380281.979360:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935535488 00000100:00100000:2.0:1787380281.979446:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787380281.979458:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+12:5783:x1874203935535488:12345-0@lo:101: 00010000:00010000:2.0:1787380281.979479:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380281.979504:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884241a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842413 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380281.979538:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884241a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842413 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380281.979551:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884241a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842413 expref: 13 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380281.979562:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3e00, rc 0) 00000100:00100000:2.0:1787380281.979651:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935535488:12345-0@lo:101: Request processed in 195us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380281.979678:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787380281.980358:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935535488:0@lo:101: 00010000:00010000:3.0:1787380281.980382:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380281.980394:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380281.980476:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935535616:0@lo:501: 00000100:00100000:3.0:1787380281.980524:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.980616:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380281.980956:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935535616 00000100:00100000:2.0:1787380281.980964:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935535616 00000100:00100000:2.0:1787380281.981074:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787380281.981086:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935535616:12345-0@lo:501: 00000100:00100000:2.0:1787380281.981466:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935535616:12345-0@lo:501: Request processed in 381us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380281.981474:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787380281.981558:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935535616:0@lo:501: 00000100:00100000:3.0:1787380281.981594:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935535744:0@lo:503: 00000100:00100000:3.0:1787380281.981640:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.981957:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380281.981994:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935535744 00000100:00100000:0.0:1787380281.982000:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935535744 00000100:00100000:2.0:1787380281.982044:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787380281.982053:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935535744:12345-0@lo:503: 00000100:00100000:2.0:1787380281.982244:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935535744:12345-0@lo:503: Request processed in 192us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380281.982251:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787380281.982941:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935535744:0@lo:503: 00000100:00100000:3.0:1787380281.983560:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8305:1874203935535872:0@lo:502: 00000100:00100000:3.0:1787380281.983626:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.983668:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380281.983724:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935535872 00000100:00100000:1.0:1787380281.983730:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935535872 00000100:00100000:1.0:1787380281.983769:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787380281.983777:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:8305:x1874203935535872:12345-0@lo:502: 00000100:00100000:1.0:1787380281.984042:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:8305:x1874203935535872:12345-0@lo:502: Request processed in 264us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380281.984050:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787380281.984157:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8305:1874203935535872:0@lo:502: 00000100:00100000:3.0:1787380281.984197:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8305:1874203935536000:0@lo:502: 00000100:00100000:3.0:1787380281.984231:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.984253:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380281.984456:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536000 00000100:00100000:1.0:1787380281.984461:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536000 00000100:00100000:1.0:1787380281.984484:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787380281.984491:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:8305:x1874203935536000:12345-0@lo:502: 00000100:00100000:1.0:1787380281.984648:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:8305:x1874203935536000:12345-0@lo:502: Request processed in 158us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380281.984656:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787380281.984735:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8305:1874203935536000:0@lo:502: 00000040:00080000:3.0:1787380281.984752:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787380281.984929:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787380281.984948:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787380281.984960:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380281.984973:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380281.984982:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787380281.984986:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787380281.984989:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787380281.985018:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380281.985027:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380281.985048:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380281.985064:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536128:0@lo:101: 00000100:00100000:1.0:1787380281.985093:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380281.985190:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e65780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380281.985237:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536128 00000100:00100000:3.0:1787380281.985242:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536128 00000100:00100000:3.0:1787380281.985262:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787380281.985267:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+13:5783:x1874203935536128:12345-0@lo:101: 00010000:00010000:3.0:1787380281.985276:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380281.985524:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af54200/0x651a07d118842428 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842421 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380281.985552:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af54200/0x651a07d118842428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842421 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380281.985563:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af54200/0x651a07d118842428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842421 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380281.985573:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54200, rc 0) 00000100:00100000:3.0:1787380281.985617:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935536128:12345-0@lo:101: Request processed in 349us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380281.985632:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787380281.985703:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698cea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536128:0@lo:101: 00010000:00010000:0.0:1787380281.985717:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380281.985728:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380281.985783:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536256:0@lo:501: 00000100:00100000:0.0:1787380281.985822:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380281.985851:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aae0e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380281.985894:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536256 00000100:00100000:3.0:1787380281.985899:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536256 00000100:00100000:3.0:1787380281.985929:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787380281.985937:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935536256:12345-0@lo:501: 00000100:00100000:3.0:1787380281.986202:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935536256:12345-0@lo:501: Request processed in 266us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380281.986209:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787380281.986404:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536256:0@lo:501: 00000100:00100000:0.0:1787380281.986434:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536384:0@lo:503: 00000100:00100000:0.0:1787380281.986475:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380281.986498:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aae0e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380281.986589:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536384 00000100:00100000:2.0:1787380281.986594:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536384 00000100:00100000:2.0:1787380281.986620:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787380281.986627:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935536384:12345-0@lo:503: 00000100:00100000:2.0:1787380281.986784:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935536384:12345-0@lo:503: Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380281.986792:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787380281.986887:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536384:0@lo:503: 00000100:00100000:3.0:1787380281.987474:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8306:1874203935536512:0@lo:502: 00000100:00100000:3.0:1787380281.987526:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.987561:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380281.987615:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536512 00000100:00100000:2.0:1787380281.987621:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536512 00000100:00100000:2.0:1787380281.987670:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787380281.987678:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:8306:x1874203935536512:12345-0@lo:502: 00000100:00100000:2.0:1787380281.987882:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:8306:x1874203935536512:12345-0@lo:502: Request processed in 204us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380281.987898:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787380281.988022:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8306:1874203935536512:0@lo:502: 00000020:01000000:3.0:1787380281.988048:0:8306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380281.988058:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380281.988061:0:8306:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380281.988067:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787380281.988091:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8306:1874203935536640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380281.988138:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.988161:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96be201d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380281.988211:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536640 00000100:00100000:0.0:1787380281.988216:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536640 00000100:00100000:0.0:1787380281.988249:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787380281.988256:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:8306:x1874203935536640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380281.988437:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:8306:x1874203935536640:12345-0@lo:502:llog_process_th.0 Request processed in 180us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380281.988444:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787380281.988598:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8306:1874203935536640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380281.988620:0:8306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380281.988625:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380281.988627:0:8306:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380281.988631:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787380281.988796:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787380281.988835:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787380281.988847:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380281.988859:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380281.988870:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787380281.988873:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d96ba3b2800 from 39 10000000:01000000:0.0:1787380281.988876:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787380281.988905:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380281.988914:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380281.988923:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380281.988939:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380281.988980:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380281.989012:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aae0e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380281.989070:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536768 00000100:00100000:2.0:1787380281.989076:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536768 00000100:00100000:2.0:1787380281.989126:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787380281.989134:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:5783:x1874203935536768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380281.989146:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380281.989163:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2a00/0x651a07d118842436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884242f expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380281.989189:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2a00/0x651a07d118842436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884242f expref: 15 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380281.989202:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2a00/0x651a07d118842436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884242f expref: 15 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380281.989213:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2a00, rc 0) 00000100:00100000:2.0:1787380281.989249:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935536768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380281.989255:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787380281.989400:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380281.989414:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380281.989423:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380281.989473:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380281.989501:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380281.989528:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aae0e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380281.989614:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935536896 00000100:00100000:3.0:1787380281.989618:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935536896 00000100:00100000:3.0:1787380281.989651:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787380281.989669:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935536896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380281.989949:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935536896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380281.989956:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787380281.990023:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935536896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380281.990050:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380281.990088:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380281.990108:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aae0e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380281.990216:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537024 00000100:00100000:3.0:1787380281.990220:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537024 00000100:00100000:3.0:1787380281.990319:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787380281.990326:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935537024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380281.990499:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935537024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380281.990506:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787380281.993859:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380281.994285:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8307:1874203935537152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380281.994424:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380281.998276:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e656c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380282.001918:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537152 00000100:00100000:0.0:1787380282.001942:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537152 00000100:00100000:0.0:1787380282.002014:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787380282.002026:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:8307:x1874203935537152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380282.002490:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:8307:x1874203935537152:12345-0@lo:502:llog_process_th.0 Request processed in 463us (8064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380282.002499:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787380282.005383:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8307:1874203935537152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380282.005496:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8307:1874203935537280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380282.005589:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380282.005632:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e656c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380282.005716:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537280 00000100:00100000:0.0:1787380282.005724:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537280 00000100:00100000:0.0:1787380282.005789:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787380282.005807:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:8307:x1874203935537280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380282.006106:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:8307:x1874203935537280:12345-0@lo:502:llog_process_th.0 Request processed in 299us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380282.006115:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787380282.006289:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8307:1874203935537280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787380282.006310:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787380282.006408:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787380282.006441:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380282.006454:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.006467:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380282.006479:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787380282.006482:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787380282.006486:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787380282.006523:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.006533:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.006544:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380282.006572:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380282.006607:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380282.006643:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787380282.007267:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537408 00000100:00100000:0.0:1787380282.007274:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537408 00000100:00100000:0.0:1787380282.007323:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787380282.007331:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:5783:x1874203935537408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380282.007653:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380282.007673:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1fc00/0x651a07d118842444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884243d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.007704:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1fc00/0x651a07d118842444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884243d expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.007717:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1fc00/0x651a07d118842444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884243d expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.007728:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1fc00, rc 0) 00000100:00100000:0.0:1787380282.007797:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935537408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 467us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380282.007805:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787380282.007925:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380282.007941:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380282.007950:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380282.008012:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380282.008058:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380282.008091:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380282.008136:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537536 00000100:00100000:2.0:1787380282.008142:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537536 00000100:00100000:2.0:1787380282.008175:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787380282.008183:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935537536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.008508:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935537536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380282.008515:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787380282.008592:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380282.008621:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380282.008657:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380282.008678:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380282.008725:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537664 00000100:00100000:2.0:1787380282.008734:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537664 00000100:00100000:2.0:1787380282.008792:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787380282.008800:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935537664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.008960:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935537664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380282.008967:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787380282.008999:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935537664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380282.011786:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8308:1874203935537792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380282.011910:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380282.011957:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380282.011985:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537792 00000100:00100000:1.0:1787380282.011995:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537792 00000100:00100000:1.0:1787380282.012101:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787380282.012112:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:8308:x1874203935537792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380282.012443:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:8308:x1874203935537792:12345-0@lo:502:llog_process_th.0 Request processed in 331us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380282.012451:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787380282.012467:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8308:1874203935537792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380282.012501:0:8308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380282.012512:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380282.012515:0:8308:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380282.012521:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787380282.012544:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8308:1874203935537920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380282.012576:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380282.016415:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaddb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380282.019268:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935537920 00000100:00100000:0.0:1787380282.019289:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935537920 00000100:00100000:0.0:1787380282.019383:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787380282.019393:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:8308:x1874203935537920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380282.019806:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:8308:x1874203935537920:12345-0@lo:502:llog_process_th.0 Request processed in 413us (7227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380282.019832:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8308:1874203935537920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380282.019845:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000020:01000000:3.0:1787380282.019902:0:8308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380282.019916:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380282.019919:0:8308:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380282.019926:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787380282.020252:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787380282.020278:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787380282.020289:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.020300:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380282.020310:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787380282.020312:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d968b549800 from 39 10000000:01000000:0.0:1787380282.020315:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787380282.020386:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.020395:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.020405:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380282.020428:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380282.020473:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380282.020516:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380282.020524:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538048 00000100:00100000:3.0:1787380282.020533:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538048 00000100:00100000:3.0:1787380282.020576:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787380282.020585:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935538048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380282.020605:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380282.020626:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af55800/0x651a07d118842452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884244b expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.020669:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55800/0x651a07d118842452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884244b expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.020684:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af55800/0x651a07d118842452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884244b expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.020695:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55800, rc 0) 00000100:00100000:3.0:1787380282.020767:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935538048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380282.020774:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787380282.020904:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380282.020921:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.020959:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380282.021012:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380282.021055:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380282.021076:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380282.021099:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538176 00000100:00100000:3.0:1787380282.021107:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538176 00000100:00100000:3.0:1787380282.021131:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787380282.021137:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935538176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380282.021475:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935538176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380282.021482:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787380282.021604:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380282.022104:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380282.022153:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380282.022190:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380282.022205:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538304 00000100:00100000:3.0:1787380282.022222:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538304 00000100:00100000:3.0:1787380282.022264:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787380282.022272:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935538304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380282.022500:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935538304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380282.022507:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787380282.022903:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.024581:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8309:1874203935538432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380282.024674:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380282.024720:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380282.024866:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538432 00000100:00100000:1.0:1787380282.024873:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538432 00000100:00100000:1.0:1787380282.024927:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787380282.024936:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8309:x1874203935538432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380282.025229:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8309:x1874203935538432:12345-0@lo:502:llog_process_th.0 Request processed in 294us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380282.025237:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787380282.025646:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8309:1874203935538432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380282.025708:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8309:1874203935538560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380282.025747:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380282.025784:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380282.025885:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538560 00000100:00100000:0.0:1787380282.025892:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538560 00000100:00100000:0.0:1787380282.025941:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787380282.025951:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8309:x1874203935538560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380282.026418:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8309:x1874203935538560:12345-0@lo:502:llog_process_th.0 Request processed in 467us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380282.026427:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787380282.027933:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8309:1874203935538560:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787380282.027998:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787380282.028527:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787380282.028562:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787380282.028577:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380282.028590:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380282.030279:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787380282.030290:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787380282.030297:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787380282.030485:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380282.030499:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380282.030513:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380282.030559:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.030646:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380282.030819:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380282.030865:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538688 00000100:00100000:3.0:1787380282.030875:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538688 00000100:00100000:3.0:1787380282.030970:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787380282.031052:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935538688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380282.031072:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380282.031086:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af55e00/0x651a07d118842460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842459 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.031113:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55e00/0x651a07d118842460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842459 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.031125:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af55e00/0x651a07d118842460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842459 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.031137:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55e00, rc 0) 00000100:00100000:3.0:1787380282.031221:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935538688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380282.031291:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380282.031306:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380282.031315:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380282.031438:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.031464:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380282.031488:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380282.031588:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538816 00000100:00100000:0.0:1787380282.031594:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538816 00000100:00100000:0.0:1787380282.031633:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787380282.031644:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935538816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380282.031885:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787380282.032003:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935538816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380282.032011:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787380282.032169:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.032205:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.032245:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380282.032279:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380282.033831:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935538944 00000100:00100000:3.0:1787380282.033846:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935538944 00000100:00100000:3.0:1787380282.033902:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787380282.033914:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935538944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380282.034968:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935538944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1049us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380282.034980:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787380282.035488:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935538944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380282.036062:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8310:1874203935539072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380282.036138:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380282.036220:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380282.042568:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539072 00000100:00100000:1.0:1787380282.042590:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539072 00000100:00100000:1.0:1787380282.042670:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787380282.042682:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8310:x1874203935539072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380282.043137:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8310:x1874203935539072:12345-0@lo:502:llog_process_th.0 Request processed in 454us (7006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380282.043155:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787380282.043286:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8310:1874203935539072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380282.043331:0:8310:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380282.043390:0:8310:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380282.043394:0:8310:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787380282.043405:0:8310:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787380282.043459:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8310:1874203935539200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380282.043510:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380282.043555:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317480 going to sleep for 11 seconds 00000100:00100000:1.0:1787380282.043655:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539200 00000100:00100000:1.0:1787380282.043662:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539200 00000100:00100000:1.0:1787380282.043706:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787380282.043715:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8310:x1874203935539200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380282.043915:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8310:x1874203935539200:12345-0@lo:502:llog_process_th.0 Request processed in 199us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380282.043923:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787380282.044039:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8310:1874203935539200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380282.044062:0:8310:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380282.044067:0:8310:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380282.044068:0:8310:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380282.044072:0:8310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787380282.045145:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787380282.045315:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787380282.045329:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380282.045369:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380282.045382:0:5783:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787380282.045386:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d9695a5b380 from 1 10000000:01000000:1.0:1787380282.045389:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787380282.045432:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380282.045441:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380282.045453:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380282.045478:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698cead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935539328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380282.045547:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380282.045775:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e65240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380282.050004:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539328 00000100:00100000:3.0:1787380282.050025:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539328 00000100:00100000:3.0:1787380282.050251:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787380282.050273:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935539328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380282.050294:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380282.050317:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af54a00/0x651a07d11884246e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842467 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.050421:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af54a00/0x651a07d11884246e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842467 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.050433:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af54a00/0x651a07d11884246e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842467 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.050444:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54a00, rc 0) 00000100:00100000:3.0:1787380282.050555:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935539328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 294us (5006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380282.050563:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787380282.050666:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698cead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935539328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380282.050689:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884246e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380282.050699:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884246e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380282.050789:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698cead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935539456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380282.050842:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380282.051051:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e65240 going to sleep for 11 seconds 00000100:00100000:2.0:1787380282.051088:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539456 00000100:00100000:2.0:1787380282.051094:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539456 00000100:00100000:2.0:1787380282.051204:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787380282.051213:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935539456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380282.051710:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935539456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 496us (865us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380282.051719:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787380282.051780:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698cead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935539456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787380282.051821:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787380282.051831:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884246e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380282.051840:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884246e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380282.873159:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380283.127926:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935539584:0@lo:400:kworker.0 00000100:00100000:2.0:1787380283.128042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380283.128160:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539584 00000100:00100000:1.0:1787380283.128170:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539584 00000100:00100000:1.0:1787380283.128245:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787380283.128254:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380283.129265:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935539712:0@lo:400:kworker.0 00000100:00100000:0.0:1787380283.129325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380283.129414:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539712 00000100:00100000:0.0:1787380283.129424:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539712 00000100:00100000:0.0:1787380283.129484:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380283.129497:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935539712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380283.129563:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935539712:12345-0@lo:400:kworker.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380283.129571:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380283.129627:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935539712:0@lo:400:kworker.0 00000100:00100000:0.0:1787380283.130898:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935539840:0@lo:400:kworker.0 00000100:00100000:0.0:1787380283.130954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380283.131009:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380283.131017:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935539968:0@lo:400:kworker.0 00000100:00100000:1.0:1787380283.131019:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935539584:12345-0@lo:400:kworker.0 Request processed in 2755us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380283.131034:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787380283.131063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380283.131103:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539968 00000100:00100000:0.0:1787380283.131109:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539968 00000100:00100000:1.0:1787380283.131369:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935540224:0@lo:400:kworker.0 00000100:00100000:1.0:1787380283.131404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380283.131465:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935539840 00000100:00100000:3.0:1787380283.131470:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935539840 00000100:00100000:1.0:1787380283.131526:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380283.131533:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935540096:0@lo:400:kworker.0 00000100:00100000:1.0:1787380283.131555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380283.131691:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935540096 00000100:00100000:3.0:1787380283.131695:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935540096 00000100:00100000:3.0:1787380283.131722:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380283.131731:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935539840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380283.131783:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935539840:12345-0@lo:400:kworker.0 Request processed in 54us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380283.131789:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380283.131813:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787380283.131832:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935540096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380283.131867:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935540096:12345-0@lo:400:kworker.0 Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380283.131873:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787380283.131913:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380283.131919:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380283.131953:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935539840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380283.132723:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935539584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380283.136555:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935540224 00000100:00100000:1.0:1787380283.136577:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935540224 00000100:00100000:1.0:1787380283.136618:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787380283.136644:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935539968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380283.136876:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935539968:12345-0@lo:400:kworker.0 Request processed in 246us (5811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380283.136885:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787380283.136963:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935540096:0@lo:400:kworker.0 00000100:00100000:1.0:1787380283.137049:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380283.137056:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380283.137095:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935540224:12345-0@lo:400:kworker.0 Request processed in 40us (5690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380283.137102:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787380283.137132:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd25ed80 x1874203935540224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380283.137145:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935540224:0@lo:400:kworker.0 00010000:00080000:3.0:1787380283.137309:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd25ea00 x1874203935539968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380283.137320:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935539968:0@lo:400:kworker.0 00000100:00080000:2.0:1787380283.137618:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380283.441660:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380283.441796:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588224 00000100:00100000:2.0:1787380283.441816:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588224 00000100:00100000:2.0:1787380283.441876:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 164 00000100:00100000:2.0:1787380283.441886:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:5570:x1874203915588224:12345-192.168.206.14@tcp:101: 00010000:00010000:2.0:1787380283.442192:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380283.442221:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2000/0x651a07d118842475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6677 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380283.442250:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2000/0x651a07d118842475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6677 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380283.442261:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2000/0x651a07d118842475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6677 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380283.442271:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2000, rc 0) 00000100:00100000:2.0:1787380283.442331:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5570:x1874203915588224:12345-192.168.206.14@tcp:101: Request processed in 445us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380283.442386:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 164 00000100:00100000:0.0:1787380283.449462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380283.449600:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588352 00000100:00100000:1.0:1787380283.449619:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588352 00000100:00100000:1.0:1787380283.449678:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 165 00000100:00100000:1.0:1787380283.449688:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5570:x1874203915588352:12345-192.168.206.14@tcp:501: 00000100:00100000:1.0:1787380283.450014:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5570:x1874203915588352:12345-192.168.206.14@tcp:501: Request processed in 326us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380283.450023:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 165 00000100:00100000:1.0:1787380283.454817:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380283.455493:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588480 00000100:00100000:2.0:1787380283.455506:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588480 00000100:00100000:2.0:1787380283.455647:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:2.0:1787380283.455664:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5570:x1874203915588480:12345-192.168.206.14@tcp:503: 00000100:00100000:2.0:1787380283.455917:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5570:x1874203915588480:12345-192.168.206.14@tcp:503: Request processed in 255us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380283.455925:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:3.0:1787380283.459198:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380283.462305:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588608 00000100:00100000:1.0:1787380283.462317:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588608 00000100:00100000:1.0:1787380283.462389:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:1.0:1787380283.462398:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:6049:x1874203915588608:12345-192.168.206.14@tcp:502: 00000100:00100000:1.0:1787380283.462657:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:6049:x1874203915588608:12345-192.168.206.14@tcp:502: Request processed in 259us (3466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380283.462665:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:0.0:1787380283.465947:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380283.466617:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588736 00000100:00100000:2.0:1787380283.466626:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588736 00000100:00100000:2.0:1787380283.466733:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 168 00000100:00100000:2.0:1787380283.466742:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:6049:x1874203915588736:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380283.467408:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:6049:x1874203915588736:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 664us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380283.467430:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 168 00000100:00100000:2.0:1787380283.469943:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380283.470105:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588864 00000100:00100000:3.0:1787380283.470124:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588864 00000100:00100000:3.0:1787380283.470177:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 169 00000100:00100000:3.0:1787380283.470187:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5570:x1874203915588864:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380283.470214:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380283.470232:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af54400/0x651a07d11884247c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f667e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380283.470259:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af54400/0x651a07d11884247c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f667e expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380283.470270:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af54400/0x651a07d11884247c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f667e expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380283.470280:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54400, rc 0) 00000100:00100000:3.0:1787380283.470379:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915588864:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 193us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380283.470387:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 169 00000100:00100000:3.0:1787380283.475300:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380283.475614:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915588992 00000100:00100000:2.0:1787380283.475623:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915588992 00000100:00100000:2.0:1787380283.475672:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 170 00000100:00100000:2.0:1787380283.475680:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915588992:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380283.475939:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915588992:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 258us (647us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380283.475948:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 170 00000100:00100000:3.0:1787380283.639771:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935540352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380283.639873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380283.640054:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935540352 00000100:00100000:2.0:1787380283.640065:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935540352 00000100:00100000:2.0:1787380283.640149:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380283.640160:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935540352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380283.640202:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380283.645860:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935540352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5686us (5971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380283.645878:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787380283.647324:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ceb100 x1874203935540352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380283.648396:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935540352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787380283.895554:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380284.663716:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380284.663756:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935540480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380284.663865:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380284.664263:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935540480 00000100:00100000:2.0:1787380284.664281:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935540480 00000100:00100000:2.0:1787380284.664380:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787380284.664391:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935540480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380284.664441:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380284.664497:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935540480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380284.664505:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787380284.664603:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd264700 x1874203935540480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380284.664623:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935540480:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1787380284.819484:0:8347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffcf6265470 00000020:00000080:3.0:1787380284.819499:0:8347:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787380284.819504:0:8347:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787380284.819511:0:8347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf6267700 20000000:00000080:3.0:1787380284.819517:0:8347:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d96b51f9000 uarg=0000000000000000 20000000:01000000:3.0:1787380284.819554:0:8347:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787380284.819559:0:8347:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787380284.819564:0:8347:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787380284.820274:0:8348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787380284.821196:0:8347:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787380284.829409:0:8347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787380284.829467:0:8347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787380284.829525:0:8347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787380284.829547:0:8347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787380284.829566:0:8347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829586:0:8347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216ca00/0x651a07d1188421f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188421f1 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829596:0:8347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842253 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829605:0:8347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884231e expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829627:0:8347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829636:0:8347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829674:0:8347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829689:0:8347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 9 pid: 5780 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.829703:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540608:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380284.829827:0:8347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d11884231e expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829836:0:8347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d11884231e expref: 18 pid: 5780 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.829846:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540736:0@lo:104: 00000100:00100000:2.0:1787380284.829897:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380284.829936:0:8347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842253 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.829944:0:8347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842253 expref: 18 pid: 5779 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.829952:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540864:0@lo:104: 00000100:00100000:2.0:1787380284.829983:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380284.830004:0:8347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216ca00/0x651a07d1188421f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188421f1 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.830013:0:8347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96c216ca00/0x651a07d1188421f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188421f1 expref: 18 pid: 5781 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.830021:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540992:0@lo:104: 00000100:00100000:2.0:1787380284.830038:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380284.830281:0:5770:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787380284.830301:0:5770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380284.830328:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935540736 00000100:00100000:3.0:1787380284.830334:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935540736 00000100:00100000:2.0:1787380284.830362:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935540864 00000100:00100000:2.0:1787380284.830368:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935540864 00000100:00100000:2.0:1787380284.830395:0:8291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935540992 00000100:00100000:2.0:1787380284.830399:0:8291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935540992 00000100:00100000:3.0:1787380284.830401:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787380284.830413:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:8347:x1874203935540736:12345-0@lo:104: 00000100:00100000:2.0:1787380284.830420:0:8291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787380284.830428:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.830429:0:8291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:8347:x1874203935540864:12345-0@lo:104: 00010000:00010000:2.0:1787380284.830442:0:8291:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830498:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380284.830505:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:8347:x1874203935540736:12345-0@lo:104: Request processed in 95us (608us total) trans 0 rc 0/0 00010000:00010000:2.0:1787380284.830507:0:8291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380284.830517:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787380284.830517:0:8291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:8347:x1874203935540864:12345-0@lo:104: Request processed in 88us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380284.830527:0:8291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787380284.830541:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787380284.830551:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:8347:x1874203935540992:12345-0@lo:104: 00010000:00010000:3.0:1787380284.830560:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.830588:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540736:0@lo:104: 00010000:00010000:3.0:1787380284.830592:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787380284.830599:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:8347:x1874203935540992:12345-0@lo:104: Request processed in 51us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380284.830605:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787380284.830622:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787380284.830629:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830637:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163aa00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380284.830641:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830648:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380284.830662:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380284.830668:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380284.830694:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830700:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380284.830720:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830728:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163aa00/0x651a07d11884231e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842325 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830740:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380284.830743:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830750:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9680030a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380284.830753:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.830759:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.830766:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540864:0@lo:104: 10000000:00010000:3.0:1787380284.830768:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380284.830775:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787380284.831037:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540992:0@lo:104: 00010000:00010000:3.0:1787380284.831524:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831534:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380284.831543:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831549:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9680030a00/0x651a07d118842253 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884225a expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831561:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380284.831565:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831570:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380284.831574:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831581:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380284.831588:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380284.831593:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380284.831605:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831611:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380284.831630:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831648:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188421f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188421f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.831661:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380284.831663:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380284.831665:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380284.831679:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935541120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380284.831723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380284.831757:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380284.831764:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935541248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380284.831809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380284.831840:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935541120 00000100:00100000:3.0:1787380284.831845:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935541120 00010000:00010000:3.0:1787380284.831871:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884231e expref: 19 pid: 5780 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380284.831884:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935541376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380284.831898:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935541248 00000100:00100000:3.0:1787380284.831902:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935541248 00010000:00010000:3.0:1787380284.831918:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842253 expref: 20 pid: 5779 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380284.831923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380284.831938:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935541376 00000100:00100000:3.0:1787380284.831942:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935541376 00010000:00010000:3.0:1787380284.831955:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216ca00/0x651a07d1188421f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421f1 expref: 21 pid: 5781 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380284.831968:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787380284.831974:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+21:3299:x1874203935541120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380284.831993:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380284.832010:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884231e expref: 21 pid: 5780 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832020:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d11884231e expref: 21 pid: 5780 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832034:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163a600/0x651a07d118842325 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d11884231e expref: 21 pid: 5780 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832056:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380284.832099:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+20:3299:x1874203935541120:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380284.832107:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787380284.832443:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380284.832452:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935541248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380284.832460:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380284.832464:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842253 expref: 19 pid: 5779 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832472:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842253 expref: 19 pid: 5779 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832483:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96813f3c00/0x651a07d11884225a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842253 expref: 19 pid: 5779 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832493:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380284.832519:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:3299:x1874203935541248:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380284.832535:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380284.832549:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380284.832555:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:3301:x1874203935541376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380284.832564:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380284.832569:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216ca00/0x651a07d1188421f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188421f1 expref: 17 pid: 5781 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832577:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216ca00/0x651a07d1188421f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188421f1 expref: 17 pid: 5781 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832586:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216ca00/0x651a07d1188421f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188421f1 expref: 17 pid: 5781 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.832596:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380284.832626:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3301:x1874203935541376:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380284.832632:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380284.832669:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935541376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380284.832841:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935541248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380284.832848:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935541120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380284.833304:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380284.841507:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380284.841579:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915589120 00000100:00100000:0.0:1787380284.841592:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915589120 00010000:00010000:0.0:1787380284.841652:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 10 pid: 5780 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380284.841694:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:0.0:1787380284.841703:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915589120:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380284.841717:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380284.841723:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 10 pid: 5780 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.841735:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 10 pid: 5780 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.841755:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.841776:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842036:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842046:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842051:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842058:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842064:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2e00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380284.842068:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842075:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842085:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380284.842095:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380284.842173:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915589120:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 470us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380284.842181:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 24 00010000:00010000:2.0:1787380284.843664:0:8347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163a800/0x651a07d1188423e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6646 expref: 9 pid: 5780 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380284.843686:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8347:1874203935540608:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380284.843730:0:8347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.843739:0:8347:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.843746:0:8347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380284.843752:0:8347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2e00/0x651a07d118842483 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380284.925524:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380285.943502:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380286.325729:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380286.325774:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380286.325824:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380286.325853:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380286.325883:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915589248 00000100:00100000:3.0:1787380286.325892:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915589248 00000100:00100000:3.0:1787380286.325938:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 171 00000100:00100000:3.0:1787380286.325947:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:2356:x1874203915589248:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380286.326039:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:2356:x1874203915589248:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380286.326047:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 171 00000100:00100000:3.0:1787380286.326080:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915589632 00000100:00100000:3.0:1787380286.326083:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915589632 00000100:00100000:3.0:1787380286.326114:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915589504 00000100:00100000:3.0:1787380286.326117:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915589504 00000100:00100000:3.0:1787380286.326135:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:3.0:1787380286.326141:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915589632:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380286.326169:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915589632:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 28us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380286.326176:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:3.0:1787380286.326187:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1787380286.326193:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915589504:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380286.326215:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915589504:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 22us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380286.326222:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:2.0:1787380286.326327:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915589376 00000100:00100000:2.0:1787380286.326331:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915589376 00000100:00100000:2.0:1787380286.326393:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:2.0:1787380286.326400:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915589376:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380286.326431:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915589376:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380286.326437:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00080000:2.0:1787380286.326457:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380286.326461:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380286.326463:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380286.513935:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380286.514016:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915589760 00000100:00100000:3.0:1787380286.514025:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915589760 00000100:00100000:3.0:1787380286.514085:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 172 00000100:00100000:3.0:1787380286.514095:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:5570:x1874203915589760:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380286.514110:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380286.514128:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6685 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380286.514155:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380286.514174:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 10 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380286.514183:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54e00, rc 0) 00000100:00100000:3.0:1787380286.514249:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915589760:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 155us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380286.514256:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 172 00000100:00100000:0.0:1787380286.523847:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380286.524048:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915589888 00000100:00100000:1.0:1787380286.524058:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915589888 00000100:00100000:1.0:1787380286.524117:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 173 00000100:00100000:1.0:1787380286.524127:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915589888:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.524516:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915589888:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 388us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.524524:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 173 00000100:00100000:1.0:1787380286.534027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380286.535590:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590016 00000100:00100000:3.0:1787380286.535603:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590016 00000100:00100000:3.0:1787380286.535660:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 174 00000100:00100000:3.0:1787380286.535668:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915590016:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380286.538046:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:5570:x1874203915590016:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 2363us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380286.538059:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 174 00000100:00100000:0.0:1787380286.548811:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380286.549898:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590144 00000100:00100000:2.0:1787380286.549910:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590144 00000100:00100000:2.0:1787380286.549964:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 175 00000100:00100000:2.0:1787380286.549975:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:6112:x1874203915590144:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380286.550209:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:6112:x1874203915590144:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 235us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380286.550226:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 175 00000100:00100000:0.0:1787380286.556037:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380286.556181:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590272 00000100:00100000:3.0:1787380286.556191:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590272 00000100:00100000:3.0:1787380286.556245:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 176 00000100:00100000:3.0:1787380286.556255:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:6112:x1874203915590272:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380286.556532:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:6112:x1874203915590272:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 278us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380286.556541:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 176 10000000:01000000:1.0:1787380286.715424:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380286.715432:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d969f0ea800 from 4 10000000:01000000:1.0:1787380286.715437:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380286.715481:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380286.715501:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380286.715513:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380286.715536:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935541504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.715602:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380286.715644:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380286.715664:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935541504 00000100:00100000:1.0:1787380286.715670:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935541504 00000100:00100000:1.0:1787380286.715712:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787380286.715720:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935541504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380286.715732:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380286.715744:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842491 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380286.715766:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842491 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380286.715777:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842491 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380286.715796:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96813f3600, rc 0) 00000100:00100000:1.0:1787380286.715833:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935541504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.715840:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787380286.715894:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935541504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380286.715906:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380286.715914:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380286.715965:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935541632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.718161:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380286.718213:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380286.718494:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935541632 00000100:00100000:2.0:1787380286.718501:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935541632 00000100:00100000:2.0:1787380286.718541:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787380286.718549:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935541632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.718769:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935541632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380286.718777:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787380286.719742:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935541632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.719803:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935541760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.719856:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380286.719888:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380286.719952:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935541760 00000100:00100000:1.0:1787380286.719957:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935541760 00000100:00100000:1.0:1787380286.719989:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787380286.719996:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935541760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.720146:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935541760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.720154:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787380286.720549:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935541760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.721360:0:8414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8414:1874203935541888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380286.721414:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380286.721437:0:8414:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380286.721438:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935541888 00000100:00100000:2.0:1787380286.721444:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935541888 00000100:00100000:2.0:1787380286.721477:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787380286.721494:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8414:x1874203935541888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380286.721675:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8414:x1874203935541888:12345-0@lo:502:llog_process_th.0 Request processed in 190us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380286.721683:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787380286.721979:0:8414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8414:1874203935541888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380286.722001:0:8414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380286.722010:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380286.722012:0:8414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787380286.722019:0:8414:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d969f0ea800 00000020:00000080:1.0:1787380286.722021:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380286.722086:0:8414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8414:1874203935542016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380286.722122:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380286.722142:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542016 00000100:00100000:1.0:1787380286.722145:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542016 00000100:00100000:1.0:1787380286.722168:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787380286.722174:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8414:x1874203935542016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380286.722284:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:8414:x1874203935542016:12345-0@lo:502:llog_process_th.0 Request processed in 109us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.722291:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787380286.722319:0:8414:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e65900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380286.722331:0:8414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8414:1874203935542016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380286.722365:0:8414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380286.722370:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380286.722372:0:8414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787380286.722375:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787380286.724049:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787380286.724079:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380286.724089:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380286.724121:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380286.724132:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380286.724134:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96ba3b2800 from 4 10000000:01000000:2.0:1787380286.724137:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380286.724166:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380286.724173:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380286.724182:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380286.724200:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.724381:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380286.724417:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380286.724437:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542144 00000100:00100000:2.0:1787380286.724443:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542144 00000100:00100000:2.0:1787380286.724484:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787380286.724493:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935542144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380286.724503:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380286.724515:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884249f expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380286.724535:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884249f expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380286.724556:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884249f expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380286.724564:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3a00, rc 0) 00000100:00100000:2.0:1787380286.724598:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935542144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380286.724605:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787380286.724648:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380286.724659:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380286.724667:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380286.724708:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.724732:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380286.724744:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380286.724754:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542272 00000100:00100000:2.0:1787380286.724757:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542272 00000100:00100000:2.0:1787380286.724777:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787380286.724793:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935542272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.725847:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935542272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1060us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380286.725858:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787380286.725899:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.725944:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.725982:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380286.726015:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380286.729005:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542400 00000100:00100000:1.0:1787380286.729016:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542400 00000100:00100000:1.0:1787380286.729061:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787380286.729070:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935542400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.729283:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935542400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (3300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.729302:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787380286.731723:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380286.738891:0:8418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8418:1874203935542528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380286.738977:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380286.739026:0:8418:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9691973300 going to sleep for 11 seconds 00000100:00100000:2.0:1787380286.742370:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542528 00000100:00100000:2.0:1787380286.742382:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542528 00000100:00100000:2.0:1787380286.742437:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787380286.742446:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8418:x1874203935542528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380286.742676:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8418:x1874203935542528:12345-0@lo:502:llog_process_th.0 Request processed in 229us (3697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380286.742684:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787380286.743415:0:8418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8418:1874203935542528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787380286.743451:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380286.743460:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380286.743463:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787380286.743472:0:8418:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96ba3b2800 00000020:00000080:0.0:1787380286.743474:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787380286.750622:0:8418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8418:1874203935542656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380286.750700:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380286.750739:0:8418:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9691973300 going to sleep for 11 seconds 00000100:00100000:1.0:1787380286.750778:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542656 00000100:00100000:1.0:1787380286.750801:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542656 00000100:00100000:1.0:1787380286.750858:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787380286.750867:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8418:x1874203935542656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380286.751404:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:8418:x1874203935542656:12345-0@lo:502:llog_process_th.0 Request processed in 537us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.751418:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787380286.751958:0:8418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8418:1874203935542656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787380286.751988:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380286.751995:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380286.751997:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787380286.752004:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787380286.752678:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787380286.752699:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380286.752710:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380286.752721:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380286.752731:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380286.752740:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d968b549800 from 4 10000000:01000000:0.0:1787380286.752743:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380286.752771:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380286.752780:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380286.752801:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380286.752820:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380286.752863:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380286.752902:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9691973300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380286.752920:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542784 00000100:00100000:0.0:1787380286.752924:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542784 00000100:00100000:0.0:1787380286.752958:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787380286.752965:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935542784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380286.752976:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380286.752987:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188424ad expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380286.753008:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188424ad expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380286.753019:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188424ad expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380286.753026:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f400, rc 0) 00000100:00100000:0.0:1787380286.753059:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935542784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380286.753071:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787380286.753120:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380286.753130:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380286.753138:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380286.753179:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380286.753203:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380286.753215:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9691973300 going to sleep for 11 seconds 00000100:00100000:1.0:1787380286.754390:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935542912 00000100:00100000:1.0:1787380286.754400:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935542912 00000100:00100000:1.0:1787380286.754430:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787380286.754438:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935542912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.754674:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935542912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.754682:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787380286.757052:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935542912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.757112:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935543040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380286.757179:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380286.757211:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380286.758856:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543040 00000100:00100000:1.0:1787380286.758885:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543040 00000100:00100000:1.0:1787380286.759039:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787380286.759049:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935543040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380286.759665:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935543040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 615us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380286.759673:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787380286.766461:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935543040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380286.766839:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8420:1874203935543168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380286.766910:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380286.766950:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9692393e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380286.766995:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543168 00000100:00100000:0.0:1787380286.767001:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543168 00000100:00100000:0.0:1787380286.767048:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787380286.767057:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:8420:x1874203935543168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380286.767260:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:8420:x1874203935543168:12345-0@lo:502:llog_process_th.0 Request processed in 203us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380286.767268:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787380286.767449:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8420:1874203935543168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380286.767471:0:8420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380286.767479:0:8420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380286.767482:0:8420:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787380286.767488:0:8420:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d968b549800 00000020:00000080:3.0:1787380286.767490:0:8420:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787380286.767544:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8420:1874203935543296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380286.767592:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380286.767622:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9692393e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380286.767660:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543296 00000100:00100000:0.0:1787380286.767664:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543296 00000100:00100000:0.0:1787380286.767688:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787380286.767694:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:8420:x1874203935543296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380286.767823:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:8420:x1874203935543296:12345-0@lo:502:llog_process_th.0 Request processed in 128us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380286.767830:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787380286.768056:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:8420:1874203935543296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380286.768075:0:8420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380286.768079:0:8420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380286.768081:0:8420:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787380286.768084:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787380286.775886:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787380286.775920:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380286.775930:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380286.775944:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380286.967505:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380287.993655:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380288.248853:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935543552:0@lo:400:kworker.0 00000100:00100000:0.0:1787380288.248922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380288.248992:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935544064:0@lo:400:kworker.0 00000100:00100000:3.0:1787380288.249010:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935543808:0@lo:400:kworker.0 00000100:00100000:0.0:1787380288.249018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380288.249037:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380288.249049:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380288.249055:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787380288.249055:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935543680:0@lo:400:kworker.0 00000100:00100000:3.0:1787380288.249059:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935543424:0@lo:400:kworker.0 00000100:00100000:2.0:1787380288.249164:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544064 00000100:00100000:2.0:1787380288.249172:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544064 00000100:00100000:2.0:1787380288.249235:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543808 00000100:00100000:2.0:1787380288.249238:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543808 00000100:00100000:2.0:1787380288.249257:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380288.249267:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935544064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380288.249521:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543552 00000100:00100000:1.0:1787380288.249526:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543552 00000100:00100000:1.0:1787380288.249558:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787380288.249578:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935543552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380288.249876:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380288.249924:0:6576:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787380288.249932:0:6576:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787380288.249944:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380288.249948:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380288.250048:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380288.250055:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935543808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380288.250094:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935543808:12345-0@lo:400:kworker.0 Request processed in 40us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380288.250102:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380288.250551:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543680 00000100:00100000:0.0:1787380288.250556:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543680 00000100:00100000:0.0:1787380288.250589:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380288.250596:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935543680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380288.251199:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935543680:12345-0@lo:400:kworker.0 Request processed in 601us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380288.251208:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787380288.251302:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380288.251434:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935543680:0@lo:400:kworker.0 00000100:00100000:3.0:1787380288.260612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380288.260678:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935543936:0@lo:400:kworker.0 00000100:00100000:3.0:1787380288.260725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787380288.260794:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce9880 x1874203935543808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380288.260827:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935543808:0@lo:400:kworker.0 00000100:00100000:3.0:1787380288.260867:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543936 00000100:00100000:3.0:1787380288.260873:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543936 00000100:00100000:3.0:1787380288.260926:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787380288.260935:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935543936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380288.261022:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935543424 00000100:00100000:0.0:1787380288.261026:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935543424 00000100:00100000:0.0:1787380288.261064:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787380288.261072:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935543424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380288.262973:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935543936:12345-0@lo:400:kworker.0 Request processed in 2031us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380288.264160:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787380288.264206:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380288.264261:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935543936:0@lo:400:kworker.0 00000100:00100000:2.0:1787380288.264968:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935544064:12345-0@lo:400:kworker.0 Request processed in 15699us (15945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380288.264978:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787380288.265090:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935543424:12345-0@lo:400:kworker.0 Request processed in 4017us (4482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380288.265099:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787380288.265381:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935543424:0@lo:400:kworker.0 00010000:00080000:3.0:1787380288.265797:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce8e00 x1874203935544064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380288.265809:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935544064:0@lo:400:kworker.0 00000100:00100000:1.0:1787380288.267032:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935543552:12345-0@lo:400:kworker.0 Request processed in 17447us (18103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380288.267048:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787380288.271861:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935543552:0@lo:400:kworker.0 00000100:00100000:3.0:1787380288.767197:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935544192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380288.767267:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380288.770198:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544192 00000100:00100000:1.0:1787380288.770212:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544192 00000100:00100000:1.0:1787380288.770279:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380288.770290:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935544192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380288.770325:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380288.770431:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935544192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (3162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380288.770438:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787380288.770664:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce8380 x1874203935544192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380288.770683:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935544192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380289.020709:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380289.785797:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935544320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380289.785863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380289.786112:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544320 00000100:00100000:2.0:1787380289.786119:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544320 00000100:00100000:2.0:1787380289.786166:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787380289.786175:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935544320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380289.786207:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380289.786255:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935544320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380289.786262:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787380289.786354:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d93480 x1874203935544320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380289.786372:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935544320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787380290.043483:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380291.086576:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380291.443511:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380291.443608:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380291.443653:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380291.444851:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590528 00000100:00100000:1.0:1787380291.444865:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590528 00000100:00100000:1.0:1787380291.444951:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:1.0:1787380291.444975:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915590528:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380291.445055:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915590528:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 94us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380291.445063:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00080000:1.0:1787380291.445107:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380291.449009:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590784 00000100:00100000:1.0:1787380291.449023:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590784 00000100:00100000:1.0:1787380291.449229:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:1.0:1787380291.449240:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915590784:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380291.449419:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915590784:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 89us (5717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380291.449427:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00080000:1.0:1787380291.449489:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380291.458065:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380291.468535:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590400 00000100:00100000:0.0:1787380291.468549:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590400 00000100:00100000:0.0:1787380291.468611:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 193 00000100:00100000:0.0:1787380291.468621:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2354:x1874203915590400:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380291.468699:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2354:x1874203915590400:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 79us (25045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380291.468707:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 193 00000100:00100000:1.0:1787380291.484501:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590656 00000100:00100000:1.0:1787380291.484514:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590656 00000100:00100000:1.0:1787380291.485274:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:1.0:1787380291.485289:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915590656:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380291.485889:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915590656:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 601us (27830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380291.485899:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00080000:1.0:1787380291.485931:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787380292.087554:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787380293.002171:0:8648:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787380293.113261:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380293.368427:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935544576:0@lo:400:kworker.0 00000100:00100000:1.0:1787380293.368447:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935544704:0@lo:400:kworker.0 00000100:00100000:0.0:1787380293.368545:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935544832:0@lo:400:kworker.0 00000100:00100000:2.0:1787380293.368604:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935544448:0@lo:400:kworker.0 00000100:00100000:1.0:1787380293.369638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380293.369696:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380293.369703:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935545088:0@lo:400:kworker.0 00000100:00100000:1.0:1787380293.369731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380293.369778:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544704 00000100:00100000:1.0:1787380293.369785:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544704 00000100:00100000:1.0:1787380293.369837:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380293.369845:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935544704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380293.369905:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935544704:12345-0@lo:400:kworker.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380293.370062:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380293.370089:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545088 00000100:00100000:1.0:1787380293.370093:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545088 00000100:00100000:1.0:1787380293.370132:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787380293.370138:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935545088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380293.370167:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935545088:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380293.370173:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787380293.370188:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380293.370192:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787380293.370221:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce8e00 x1874203935545088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380293.370234:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935545088:0@lo:400:kworker.0 00000100:00100000:1.0:1787380293.370245:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698cea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935544704:0@lo:400:kworker.0 00000100:00100000:3.0:1787380293.370376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380293.370413:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544576 00000100:00100000:3.0:1787380293.370418:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544576 00000100:00100000:3.0:1787380293.370445:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787380293.370451:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935544576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380293.370489:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935544576:12345-0@lo:400:kworker.0 Request processed in 38us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380293.370495:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787380293.370527:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935544576:0@lo:400:kworker.0 00000100:00100000:1.0:1787380293.372841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380293.373100:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380293.373154:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935544960:0@lo:400:kworker.0 00000100:00100000:0.0:1787380293.373191:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544448 00000100:00100000:0.0:1787380293.373199:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544448 00000100:00100000:3.0:1787380293.373208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380293.373245:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787380293.373268:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935544448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380293.373304:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544960 00000100:00100000:2.0:1787380293.373310:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544960 00000100:00100000:0.0:1787380293.373368:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935544448:12345-0@lo:400:kworker.0 Request processed in 113us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380293.373385:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787380293.373388:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380293.373399:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935544960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380293.373437:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935544960:12345-0@lo:400:kworker.0 Request processed in 41us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380293.373444:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787380293.373465:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380293.373569:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935544448:0@lo:400:kworker.0 00000100:00100000:3.0:1787380293.373585:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935544960:0@lo:400:kworker.0 00000100:00100000:0.0:1787380293.376140:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935544832 00000100:00100000:0.0:1787380293.376151:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935544832 00000100:00080000:2.0:1787380293.376312:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380293.376573:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787380293.376585:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935544832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380293.376689:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935544832:12345-0@lo:400:kworker.0 Request processed in 107us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380293.376696:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787380293.376779:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698ce8380 x1874203935544832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380293.376793:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935544832:0@lo:400:kworker.0 00000100:00100000:2.0:1787380293.883599:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380293.883620:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935545216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380293.883684:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380293.883739:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545216 00000100:00100000:2.0:1787380293.883757:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545216 00000100:00100000:2.0:1787380293.883809:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787380293.883816:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935545216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380293.883845:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380293.883880:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935545216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380293.883887:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787380293.883920:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d90a80 x1874203935545216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380293.883935:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935545216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787380294.139660:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380294.903678:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935545344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380294.903760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380294.904054:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545344 00000100:00100000:2.0:1787380294.904063:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545344 00000100:00100000:2.0:1787380294.904115:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380294.904124:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935545344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380294.904157:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380294.904207:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935545344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380294.904214:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787380294.904386:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d90a80 x1874203935545344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380294.904404:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935545344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787380295.160920:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380296.194033:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380296.572400:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380296.572427:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380296.572451:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380296.572476:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380296.572513:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591168 00000100:00100000:1.0:1787380296.572521:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591168 00000100:00100000:1.0:1787380296.572566:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591296 00000100:00100000:1.0:1787380296.572569:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591296 00000100:00100000:1.0:1787380296.572590:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:1.0:1787380296.572598:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2352:x1874203915591168:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:1.0:1787380296.572632:0:8465:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188423f0 00000100:00080000:1.0:1787380296.572640:0:8465:0:(import.c:65:import_set_state_nolock()) ffff9d96bfd8d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380296.572670:0:8465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787380296.573012:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+2:2352:x1874203915591168:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 413us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380296.573020:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:1.0:1787380296.573038:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:1.0:1787380296.573045:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2352:x1874203915591296:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:1.0:1787380296.573061:0:8465:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188423f7 00000100:00080000:1.0:1787380296.573066:0:8465:0:(import.c:65:import_set_state_nolock()) ffff9d96bfd8e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380296.573085:0:8465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787380296.573334:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591040 00000100:00100000:3.0:1787380296.573353:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591040 00000100:00100000:3.0:1787380296.573391:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:3.0:1787380296.573398:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915591040:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380296.573432:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915591040:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 35us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380296.573448:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 41 00010000:00010000:3.0:1787380296.573465:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380296.573532:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915590912 00000100:00100000:0.0:1787380296.573537:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915590912 00000100:00100000:0.0:1787380296.573572:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 195 00000100:00100000:0.0:1787380296.573579:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915590912:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380296.573605:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915590912:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 27us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380296.573611:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 195 00000100:00080000:0.0:1787380296.573655:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380296.573660:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380296.573662:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787380296.573672:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380296.573968:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+2:2352:x1874203915591296:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 921us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380296.573976:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00010000:00010000:3.0:1787380297.211099:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380298.241239:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380298.490431:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935545600:0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.490499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380298.490547:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935546112:0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.490571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380298.490601:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380298.490607:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935545728:0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.490627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380298.490666:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545600 00000100:00100000:3.0:1787380298.490672:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545600 00000100:00100000:3.0:1787380298.490714:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545728 00000100:00100000:3.0:1787380298.490717:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545728 00000100:00100000:3.0:1787380298.490762:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787380298.490770:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935545600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.490819:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935545600:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380298.490826:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787380298.490841:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787380298.490847:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935545728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.490873:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935545728:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380298.490879:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787380298.490895:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935546112 00000100:00100000:3.0:1787380298.490898:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935546112 00000100:00100000:3.0:1787380298.490935:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380298.490942:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935546112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.490970:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935546112:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380298.490976:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787380298.490996:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380298.491000:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380298.491044:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935545728:0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.491055:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935545600:0@lo:400:kworker.0 00010000:00080000:3.0:1787380298.491066:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d95865a2a00 x1874203935546112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380298.491076:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935546112:0@lo:400:kworker.0 00000100:00100000:1.0:1787380298.492138:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935545472:0@lo:400:kworker.0 00000100:00100000:1.0:1787380298.492190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380298.492228:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935545984:0@lo:400:kworker.0 00000100:00100000:1.0:1787380298.492251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380298.492272:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380298.492279:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935545856:0@lo:400:kworker.0 00000100:00100000:1.0:1787380298.492311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380298.492358:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545856 00000100:00100000:1.0:1787380298.492364:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545856 00000100:00100000:1.0:1787380298.492400:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380298.492408:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935545856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380298.492448:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935545856:12345-0@lo:400:kworker.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380298.492455:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787380298.492487:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d95865a0700 x1874203935545856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380298.492499:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935545856:0@lo:400:kworker.0 00000100:00080000:1.0:1787380298.492514:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380298.492522:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545984 00000100:00100000:1.0:1787380298.492525:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545984 00000100:00100000:1.0:1787380298.492554:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787380298.492559:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935545984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380298.492592:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935545984:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380298.492598:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787380298.492621:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935545984:0@lo:400:kworker.0 00000100:00080000:1.0:1787380298.492636:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380298.496162:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935545472 00000100:00100000:3.0:1787380298.496175:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935545472 00000100:00100000:3.0:1787380298.496233:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787380298.496243:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935545472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380298.496332:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935545472:12345-0@lo:400:kworker.0 Request processed in 90us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380298.496354:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787380298.496410:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935545472:0@lo:400:kworker.0 00000100:00100000:2.0:1787380298.999942:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380298.999962:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935546240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380299.000025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380299.000080:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935546240 00000100:00100000:2.0:1787380299.000087:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935546240 00000100:00100000:2.0:1787380299.000138:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380299.000147:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935546240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380299.000181:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380299.000234:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935546240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380299.000242:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787380299.000278:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d90e00 x1874203935546240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380299.000295:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935546240:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787380299.140832:0:8892:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing yml_node 00010000:00010000:3.0:1787380299.258217:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380300.024803:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380300.024823:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935546368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380300.024885:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380300.024952:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935546368 00000100:00100000:2.0:1787380300.024959:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935546368 00000100:00100000:2.0:1787380300.025007:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787380300.025017:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935546368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380300.025052:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380300.025091:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935546368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.025098:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787380300.025134:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d90e00 x1874203935546368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380300.025151:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935546368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787380300.026748:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787380300.279813:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787380301.091258:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:3.0:1787380301.091266:0:7479:0:(genops.c:906:class_export_put()) final put ffff9d96bfd8c000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:0.0:1787380301.091334:0:1362:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bfd8c000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 for lustre-OST0001 00000020:00000080:0.0:1787380301.091404:0:1362:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96bfd8e000 for lustre-OST0001 00010000:00010000:3.0:1787380301.304181:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787380301.619075:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:2.0:1787380301.619085:0:6603:0:(genops.c:906:class_export_put()) final put ffff9d96bfd8f000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:0.0:1787380301.619155:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bfd8f000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 for lustre-OST0000 00000020:00000080:0.0:1787380301.619205:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96bfd8d000 for lustre-OST0000 00000100:00100000:1.0:1787380301.684579:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380301.684624:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380301.684724:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591552 00000100:00100000:2.0:1787380301.684733:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591552 00000100:00100000:2.0:1787380301.684809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:2.0:1787380301.684832:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915591552:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380301.684909:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915591552:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380301.684928:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00080000:1.0:1787380301.685032:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380301.685082:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591424 00000100:00100000:3.0:1787380301.685086:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591424 00000100:00100000:3.0:1787380301.685126:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 197 00000100:00100000:3.0:1787380301.685133:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915591424:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380301.685162:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915591424:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 30us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380301.685168:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 197 00010000:00010000:2.0:1787380302.327782:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380303.359992:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380303.607592:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935546496:0@lo:400:kworker.0 00000100:00100000:1.0:1787380303.607611:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935546752:0@lo:400:kworker.0 00000100:00100000:3.0:1787380303.607699:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935546880:0@lo:400:kworker.0 00000100:00100000:0.0:1787380303.607768:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935546624:0@lo:400:kworker.0 00000100:00100000:1.0:1787380303.607807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380303.607885:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935546752 00000100:00100000:1.0:1787380303.607892:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935546752 00000100:00100000:1.0:1787380303.607958:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787380303.607968:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935546752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380303.608022:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935546752:12345-0@lo:400:kworker.0 Request processed in 56us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380303.608030:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787380303.608053:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380303.608081:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935546752:0@lo:400:kworker.0 00000100:00100000:2.0:1787380303.617556:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380303.617689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380303.617750:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935547136:0@lo:400:kworker.0 00000100:00100000:0.0:1787380303.617784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380303.617812:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547136 00000100:00100000:0.0:1787380303.617819:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547136 00000100:00100000:0.0:1787380303.617876:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787380303.617885:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935547136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380303.617958:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935547136:12345-0@lo:400:kworker.0 Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380303.617965:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787380303.617989:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787380303.618019:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f34a80 x1874203935547136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380303.618031:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935547136:0@lo:400:kworker.0 00000100:00100000:1.0:1787380303.618095:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935547008:0@lo:400:kworker.0 00000100:00100000:1.0:1787380303.618125:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380303.618159:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935546496 00000100:00100000:3.0:1787380303.618164:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935546496 00000100:00100000:3.0:1787380303.618201:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787380303.618208:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935546496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380303.618252:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935546496:12345-0@lo:400:kworker.0 Request processed in 44us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380303.618257:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787380303.618292:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935546496:0@lo:400:kworker.0 00000100:00100000:3.0:1787380303.618323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380303.618367:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935546880 00000100:00100000:3.0:1787380303.618371:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935546880 00000100:00100000:3.0:1787380303.618399:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787380303.618405:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935546880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380303.618436:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935546880:12345-0@lo:400:kworker.0 Request processed in 31us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380303.619680:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935546624 00000100:00100000:2.0:1787380303.619701:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935546624 00000100:00100000:2.0:1787380303.619742:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547008 00000100:00100000:2.0:1787380303.619746:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547008 00000100:00100000:2.0:1787380303.619770:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787380303.619778:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935546624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380303.619839:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935546624:12345-0@lo:400:kworker.0 Request processed in 62us (2151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380303.619846:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787380303.619860:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380303.619866:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935547008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380303.619900:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935547008:12345-0@lo:400:kworker.0 Request processed in 35us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380303.619906:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787380303.620106:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787380303.620158:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935547008:0@lo:400:kworker.0 00010000:00080000:3.0:1787380303.620223:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e7ad80 x1874203935546880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380303.620233:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935546880:0@lo:400:kworker.0 00000100:00080000:0.0:1787380303.620371:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380303.620377:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380303.620401:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935546624:0@lo:400:kworker.0 00000001:02000400:3.0:1787380303.803974:0:9085:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.116 00000100:00100000:0.0:1787380304.119580:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380304.119604:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935547264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380304.119685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380304.120229:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547264 00000100:00100000:2.0:1787380304.120238:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547264 00000100:00100000:2.0:1787380304.120298:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787380304.120307:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935547264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380304.120371:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380304.120431:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935547264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380304.120438:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787380304.120573:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d90e00 x1874203935547264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380304.120592:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935547264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380304.375640:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380305.143851:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935547392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380305.143916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380305.144037:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547392 00000100:00100000:0.0:1787380305.144050:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547392 00000100:00100000:0.0:1787380305.144110:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787380305.144121:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935547392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380305.144158:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787380305.144235:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380305.144669:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935547392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 547us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380305.144677:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787380305.144759:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d90000 x1874203935547392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380305.144780:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935547392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787380305.402010:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787380306.252146:0:9183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.116 00010000:00010000:2.0:1787380306.425651:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380306.801323:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380306.801381:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380306.801430:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591808 00000100:00100000:3.0:1787380306.801440:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591808 00000100:00100000:3.0:1787380306.801511:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:3.0:1787380306.801521:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915591808:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380306.801591:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915591808:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380306.801599:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00080000:3.0:1787380306.801629:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380306.801930:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591680 00000100:00100000:2.0:1787380306.801935:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591680 00000100:00100000:2.0:1787380306.801968:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 199 00000100:00100000:2.0:1787380306.801976:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915591680:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380306.802200:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915591680:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 224us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380306.802208:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 199 00010000:00010000:3.0:1787380307.448592:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380308.474727:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380308.727580:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935547904:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.727683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380308.727755:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380308.727762:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935547520:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.727801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380308.727825:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935548032:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.727851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380308.727891:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935547648:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.727915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380308.727943:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935548160:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.727962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380308.727980:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380308.727996:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935547776:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380308.728078:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547904 00000100:00100000:1.0:1787380308.728087:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547904 00000100:00100000:1.0:1787380308.728147:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548160 00000100:00100000:1.0:1787380308.728150:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548160 00000100:00100000:1.0:1787380308.728173:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787380308.728181:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935547904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728249:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935547904:12345-0@lo:400:kworker.0 Request processed in 68us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380308.728256:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787380308.728272:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380308.728278:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935548160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728305:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935548160:12345-0@lo:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380308.728311:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380308.728329:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547520 00000100:00100000:1.0:1787380308.728332:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547520 00000100:00100000:1.0:1787380308.728379:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787380308.728385:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935547520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728410:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935547520:12345-0@lo:400:kworker.0 Request processed in 26us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380308.728416:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787380308.728443:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548032 00000100:00100000:1.0:1787380308.728446:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548032 00000100:00100000:1.0:1787380308.728473:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547648 00000100:00100000:1.0:1787380308.728476:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547648 00000100:00100000:1.0:1787380308.728486:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935547776 00000100:00100000:1.0:1787380308.728495:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935547776 00000100:00100000:1.0:1787380308.728511:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787380308.728516:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935548032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728542:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935548032:12345-0@lo:400:kworker.0 Request processed in 26us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380308.728548:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787380308.728558:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787380308.728563:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935547648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728581:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935547648:12345-0@lo:400:kworker.0 Request processed in 19us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380308.728586:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787380308.728594:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380308.728598:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935547776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728616:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935547776:12345-0@lo:400:kworker.0 Request processed in 18us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380308.728621:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787380308.728645:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380308.728650:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380308.728652:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380308.728700:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935547776:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728709:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935547648:0@lo:400:kworker.0 00010000:00080000:1.0:1787380308.728720:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e7aa00 x1874203935548160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380308.728731:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935548160:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728763:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935547520:0@lo:400:kworker.0 00000100:00100000:1.0:1787380308.728783:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935548032:0@lo:400:kworker.0 00010000:00080000:1.0:1787380308.728793:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f35180 x1874203935547904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380308.728801:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935547904:0@lo:400:kworker.0 00000001:02000400:0.0:1787380308.960199:0:9281:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.116 00000100:00100000:3.0:1787380309.241032:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380309.241063:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935548288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380309.241154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380309.241331:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548288 00000100:00100000:1.0:1787380309.241381:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548288 00000100:00100000:1.0:1787380309.241449:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787380309.241461:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935548288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380309.241515:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380309.241578:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935548288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380309.241587:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787380309.241755:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d92680 x1874203935548288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380309.241778:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935548288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380309.496678:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380310.266398:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380310.266441:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935548416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380310.266525:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380310.267500:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548416 00000100:00100000:2.0:1787380310.267512:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548416 00000100:00100000:2.0:1787380310.270821:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787380310.270844:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935548416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380310.270913:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380310.271029:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935548416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380310.271037:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787380310.273840:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787380310.274052:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d93800 x1874203935548416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380310.274098:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935548416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787380310.519609:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380310.627681:0:9329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 02:31:48 EDT 2026 00010000:00010000:3.0:1787380311.546641:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380311.926519:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380311.926570:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380311.926657:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592064 00000100:00100000:0.0:1787380311.926666:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592064 00000100:00100000:0.0:1787380311.926734:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:0.0:1787380311.926745:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915592064:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380311.926826:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915592064:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380311.926834:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00080000:1.0:1787380311.927540:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380311.927617:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915591936 00000100:00100000:2.0:1787380311.927624:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915591936 00000100:00100000:2.0:1787380311.927679:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 201 00000100:00100000:2.0:1787380311.927697:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915591936:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380311.927755:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915591936:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 61us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380311.927762:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 201 00010000:00010000:2.0:1787380312.570429:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380313.596120:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380313.850070:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935548928:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380313.850193:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787380313.850199:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935548544:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380313.850245:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935549056:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380313.850299:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935548672:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380313.850375:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935549184:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380313.850415:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380313.850420:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935548800:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380313.850469:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548928 00000100:00100000:3.0:1787380313.850476:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548928 00000100:00100000:3.0:1787380313.850521:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549184 00000100:00100000:3.0:1787380313.850530:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549184 00000100:00100000:3.0:1787380313.850554:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787380313.850562:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935548928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850613:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935548928:12345-0@lo:400:kworker.0 Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380313.850620:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787380313.850651:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787380313.850657:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935549184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850689:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935549184:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380313.850694:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787380313.850712:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548544 00000100:00100000:3.0:1787380313.850715:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548544 00000100:00100000:3.0:1787380313.850739:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787380313.850745:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935548544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.850773:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935548544:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380313.850778:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787380313.850803:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549056 00000100:00100000:3.0:1787380313.850806:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549056 00000100:00100000:3.0:1787380313.850834:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548672 00000100:00100000:3.0:1787380313.850837:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548672 00000100:00100000:3.0:1787380313.851981:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935548800 00000100:00100000:3.0:1787380313.851989:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935548800 00000100:00100000:3.0:1787380313.852012:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787380313.852021:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935549056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.852082:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935549056:12345-0@lo:400:kworker.0 Request processed in 62us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380313.852098:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787380313.852114:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787380313.852119:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935548672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.852147:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935548672:12345-0@lo:400:kworker.0 Request processed in 28us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380313.852152:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787380313.852163:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787380313.852168:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935548800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.852193:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935548800:12345-0@lo:400:kworker.0 Request processed in 25us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380313.852198:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787380313.852225:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380313.852230:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380313.852232:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380313.852271:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935548544:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.852286:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935549056:0@lo:400:kworker.0 00010000:00080000:3.0:1787380313.852301:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d95865a3480 x1874203935548928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380313.852311:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935548928:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.852381:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935548800:0@lo:400:kworker.0 00000100:00100000:3.0:1787380313.852392:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935548672:0@lo:400:kworker.0 00010000:00080000:3.0:1787380313.852403:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d95865a1880 x1874203935549184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380313.852424:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935549184:0@lo:400:kworker.0 00000100:00100000:0.0:1787380314.360888:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380314.360912:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935549312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380314.360983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380314.361266:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549312 00000100:00100000:2.0:1787380314.361275:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549312 00000100:00100000:2.0:1787380314.361361:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380314.361370:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935549312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380314.361407:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380314.361465:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935549312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380314.361472:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787380314.361670:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d90700 x1874203935549312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380314.361688:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935549312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380314.615831:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380315.384576:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380315.384607:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935549440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380315.384688:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380315.384961:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549440 00000100:00100000:2.0:1787380315.384969:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549440 00000100:00100000:2.0:1787380315.385044:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380315.385057:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935549440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380315.385100:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380315.385143:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935549440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380315.385151:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787380315.385195:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d93100 x1874203935549440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380315.385221:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935549440:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787380315.385275:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787380315.639443:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380316.663502:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380317.041425:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380317.041460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380317.041639:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592320 00000100:00100000:3.0:1787380317.041648:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592320 00000100:00100000:3.0:1787380317.041710:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:3.0:1787380317.041721:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915592320:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380317.041786:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915592320:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 67us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380317.041794:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00080000:0.0:1787380317.041849:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380317.042088:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592192 00000100:00100000:2.0:1787380317.042093:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592192 00000100:00100000:2.0:1787380317.042131:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 203 00000100:00100000:2.0:1787380317.042138:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2354:x1874203915592192:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380317.042174:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2354:x1874203915592192:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 36us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380317.042180:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 203 00010000:00010000:2.0:1787380317.688560:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380318.711864:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380318.968385:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935549952:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380318.968500:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787380318.968506:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935549568:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380318.968551:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935550080:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968572:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380318.968595:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380318.968646:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935550208:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380318.968678:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380318.968683:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380318.968744:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550080 00000100:00100000:2.0:1787380318.968750:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550080 00000100:00100000:2.0:1787380318.968798:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549696 00000100:00100000:2.0:1787380318.968801:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549696 00000100:00100000:2.0:1787380318.968826:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549824 00000100:00100000:2.0:1787380318.968829:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549824 00000100:00100000:2.0:1787380318.968846:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787380318.968854:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935550080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968899:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935550080:12345-0@lo:400:kworker.0 Request processed in 46us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380318.968906:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787380318.968921:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787380318.968927:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935549696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968954:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935549696:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380318.968959:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787380318.968970:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787380318.968975:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935549824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.968997:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935549824:12345-0@lo:400:kworker.0 Request processed in 22us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380318.969003:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787380318.969015:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380318.969040:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.969120:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787380318.969147:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935550080:0@lo:400:kworker.0 00000100:00100000:3.0:1787380318.969586:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549952 00000100:00100000:3.0:1787380318.969592:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549952 00000100:00100000:3.0:1787380318.969639:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550208 00000100:00100000:3.0:1787380318.969642:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550208 00000100:00100000:3.0:1787380318.969661:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787380318.969667:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935549952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380318.969712:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935549952:12345-0@lo:400:kworker.0 Request processed in 45us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380318.969719:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787380318.969730:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787380318.969736:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935550208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380318.969768:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935550208:12345-0@lo:400:kworker.0 Request processed in 32us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380318.969773:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787380318.969789:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935549568 00000100:00100000:3.0:1787380318.969792:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935549568 00000100:00100000:3.0:1787380318.969827:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787380318.969833:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935549568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380318.969882:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935549568:12345-0@lo:400:kworker.0 Request processed in 49us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380318.969889:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00010000:00080000:3.0:1787380318.969945:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d91180 x1874203935550208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380318.969956:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935550208:0@lo:400:kworker.0 00000100:00100000:3.0:1787380318.969979:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935549568:0@lo:400:kworker.0 00010000:00080000:3.0:1787380318.969989:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698d91f80 x1874203935549952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380318.969999:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935549952:0@lo:400:kworker.0 00000100:00080000:2.0:1787380318.970455:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380318.970459:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380319.483077:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935550336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380319.483148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380319.483221:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550336 00000100:00100000:1.0:1787380319.483228:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550336 00000100:00100000:1.0:1787380319.483273:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787380319.483282:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935550336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380319.483315:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380319.483384:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5232300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935550336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380319.483392:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787380319.483429:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5a9ca80 x1874203935550336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380319.483447:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935550336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380319.735475:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380320.505646:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380320.505672:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935550464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380320.505742:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380320.505815:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550464 00000100:00100000:0.0:1787380320.505823:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550464 00000100:00100000:0.0:1787380320.505879:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380320.505887:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935550464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380320.505932:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380320.505975:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935550464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.505981:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787380320.506003:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787380320.506029:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5a9ca80 x1874203935550464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380320.506047:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935550464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787380320.759918:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380321.784644:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380322.160980:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380322.161701:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380322.161744:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592576 00000100:00100000:1.0:1787380322.161756:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592576 00000100:00100000:1.0:1787380322.161940:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:1.0:1787380322.161952:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915592576:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380322.162041:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915592576:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 92us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380322.162048:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00080000:1.0:1787380322.162072:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380322.162128:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592448 00000100:00100000:0.0:1787380322.162144:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592448 00000100:00100000:0.0:1787380322.162220:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 205 00000100:00100000:0.0:1787380322.162231:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915592448:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380322.162329:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2353:x1874203915592448:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 99us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380322.162361:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 205 00010000:00010000:0.0:1787380322.809916:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380323.831621:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380324.089824:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935550848:0@lo:400:kworker.0 00000100:00100000:0.0:1787380324.089832:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935550592:0@lo:400:kworker.0 00000100:00100000:2.0:1787380324.089912:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935550720:0@lo:400:kworker.0 00000100:00100000:3.0:1787380324.090033:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935550976:0@lo:400:kworker.0 00000100:00100000:1.0:1787380324.090720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380324.091156:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380324.091188:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935551104:0@lo:400:kworker.0 00000100:00100000:0.0:1787380324.091216:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380324.091249:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550592 00000100:00100000:0.0:1787380324.091256:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550592 00000100:00100000:0.0:1787380324.091297:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787380324.091305:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935550592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380324.091386:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935550592:12345-0@lo:400:kworker.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380324.091394:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787380324.091424:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550848 00000100:00100000:0.0:1787380324.091428:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550848 00000100:00100000:1.0:1787380324.091436:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935551104 00000100:00100000:1.0:1787380324.091440:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935551104 00000100:00100000:0.0:1787380324.091464:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380324.091470:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935550848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380324.091471:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787380324.091477:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935551104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380324.091503:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935551104:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380324.091503:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935550848:12345-0@lo:400:kworker.0 Request processed in 34us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380324.091509:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787380324.091540:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380324.091561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380324.091575:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935550592:0@lo:400:kworker.0 00000100:00100000:2.0:1787380324.091592:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935551232:0@lo:400:kworker.0 00000100:00100000:1.0:1787380324.091601:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935551104:0@lo:400:kworker.0 00000100:00100000:2.0:1787380324.091615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380324.091629:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550720 00000100:00100000:1.0:1787380324.091632:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550720 00000100:00100000:2.0:1787380324.091641:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935551232 00000100:00100000:2.0:1787380324.091644:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935551232 00000100:00100000:2.0:1787380324.091673:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380324.091679:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935551232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380324.091703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380324.091710:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935551232:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380324.091715:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380324.091725:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935550976 00000100:00100000:2.0:1787380324.091728:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935550976 00000100:00100000:2.0:1787380324.091748:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380324.091753:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935550976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380324.091795:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935550976:12345-0@lo:400:kworker.0 Request processed in 41us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380324.091811:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787380324.092014:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5231880 x1874203935550976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380324.092026:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935550976:0@lo:400:kworker.0 00000100:00080000:2.0:1787380324.092056:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380324.092059:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787380324.092079:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5230380 x1874203935551232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380324.092091:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5230380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935551232:0@lo:400:kworker.0 00000100:00100000:0.0:1787380324.094508:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380324.094599:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5233b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935550848:0@lo:400:kworker.0 00000100:00100000:1.0:1787380324.094630:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787380324.094647:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935550720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380324.094743:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935550720:12345-0@lo:400:kworker.0 Request processed in 104us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380324.094749:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380324.094812:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935550720:0@lo:400:kworker.0 00000100:00100000:1.0:1787380324.599761:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380324.599792:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935551360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380324.599858:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380324.599955:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935551360 00000100:00100000:1.0:1787380324.599962:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935551360 00000100:00100000:1.0:1787380324.600005:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380324.600015:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935551360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380324.600049:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380324.600090:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935551360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380324.600097:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787380324.600134:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5230e00 x1874203935551360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380324.600151:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5230e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935551360:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787380324.707610:0:9959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:32:02 (1787380322) === 00010000:00010000:0.0:1787380324.867329:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380325.194012:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380325.194603:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592704 00000100:00100000:3.0:1787380325.194614:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592704 00000100:00100000:3.0:1787380325.194670:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 207 00000100:00100000:3.0:1787380325.194680:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:8106:x1874203915592704:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787380325.194698:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380325.194714:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af54000/0x651a07d1188424bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f668c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.194752:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af54000/0x651a07d1188424bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f668c expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.194764:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af54000/0x651a07d1188424bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f668c expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.194787:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54000, rc 0) 00000100:00100000:3.0:1787380325.195002:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8106:x1874203915592704:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 321us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.195010:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 207 00000100:00100000:3.0:1787380325.206547:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380325.207315:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592832 00000100:00100000:1.0:1787380325.207383:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592832 00000100:00100000:1.0:1787380325.207462:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 208 00000100:00100000:1.0:1787380325.207474:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8106:x1874203915592832:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787380325.208026:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8106:x1874203915592832:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 550us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.208036:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 208 00000100:00100000:1.0:1787380325.210331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380325.210457:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915592960 00000100:00100000:3.0:1787380325.210469:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915592960 00000100:00100000:3.0:1787380325.210537:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 209 00000100:00100000:3.0:1787380325.210550:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8106:x1874203915592960:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787380325.210918:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8106:x1874203915592960:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 363us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.210927:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 209 00000100:00100000:2.0:1787380325.232817:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380325.233057:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593088 00000100:00100000:0.0:1787380325.233070:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593088 00000100:00100000:0.0:1787380325.233139:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 210 00000100:00100000:0.0:1787380325.233150:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8110:x1874203915593088:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380325.233562:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8110:x1874203915593088:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 411us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380325.233584:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 210 00000100:00100000:0.0:1787380325.251130:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380325.251284:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593216 00000100:00100000:1.0:1787380325.251298:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593216 00000100:00100000:1.0:1787380325.251390:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 211 00000100:00100000:1.0:1787380325.251402:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8110:x1874203915593216:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787380325.251993:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8110:x1874203915593216:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 590us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.252004:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 211 00000100:00100000:1.0:1787380325.272073:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380325.276649:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593344 00000100:00100000:3.0:1787380325.276674:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593344 00000100:00100000:3.0:1787380325.276850:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 212 00000100:00100000:3.0:1787380325.276864:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:8106:x1874203915593344:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787380325.276888:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380325.276911:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af55000/0x651a07d1188424c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f66b6 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.276948:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55000/0x651a07d1188424c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66b6 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.276962:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af55000/0x651a07d1188424c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66b6 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.276994:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55000, rc 0) 00000100:00100000:3.0:1787380325.277073:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:8106:x1874203915593344:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 212us (5013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.277081:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 212 00000100:00100000:2.0:1787380325.289424:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380325.289535:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593472 00000100:00100000:0.0:1787380325.289549:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593472 00000100:00100000:0.0:1787380325.289634:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 213 00000100:00100000:0.0:1787380325.289645:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:8106:x1874203915593472:12345-192.168.206.14@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787380325.289683:0:5779:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787380325.289721:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787380325.289725:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787380325.289728:0:5779:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787380325.289731:0:5779:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787380325.293778:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:8106:x1874203915593472:12345-192.168.206.14@tcp:256:mount.lustre.0 Request processed in 4116us (4350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.293797:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 213 00000100:00100000:2.0:1787380325.302778:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380325.303089:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593600 00000100:00100000:3.0:1787380325.303106:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593600 00000100:00100000:3.0:1787380325.303178:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 214 00000100:00100000:3.0:1787380325.303189:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:8106:x1874203915593600:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787380325.303209:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380325.303230:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f66bd expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.303267:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.303278:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380325.303288:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54600, rc 0) 00000100:00100000:3.0:1787380325.303413:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8106:x1874203915593600:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 226us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.303422:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 214 00000100:00100000:2.0:1787380325.320593:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380325.320703:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593728 00000100:00100000:3.0:1787380325.320733:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593728 00000100:00100000:3.0:1787380325.320805:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 215 00000100:00100000:3.0:1787380325.320817:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8106:x1874203915593728:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380325.321198:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8106:x1874203915593728:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 380us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.321206:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 215 00000100:00100000:0.0:1787380325.339137:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380325.339291:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593856 00000100:00100000:1.0:1787380325.339306:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593856 00000100:00100000:1.0:1787380325.339402:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 216 00000100:00100000:1.0:1787380325.339413:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8106:x1874203915593856:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787380325.339724:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8106:x1874203915593856:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 311us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.339734:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 216 00000100:00100000:2.0:1787380325.348880:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380325.349383:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915593984 00000100:00100000:1.0:1787380325.349397:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915593984 00000100:00100000:1.0:1787380325.349476:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 217 00000100:00100000:1.0:1787380325.349487:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8113:x1874203915593984:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787380325.350031:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8113:x1874203915593984:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 542us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.350041:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 217 00000100:00100000:2.0:1787380325.367820:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380325.367968:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915594112 00000100:00100000:3.0:1787380325.367982:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915594112 00000100:00100000:3.0:1787380325.368069:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 218 00000100:00100000:3.0:1787380325.368081:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8113:x1874203915594112:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380325.368423:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:8113:x1874203915594112:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 343us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.368431:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 218 00000100:00100000:2.0:1787380325.387609:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380325.387659:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380325.387766:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915594624 00000100:00100000:0.0:1787380325.387787:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915594624 00000100:00100000:0.0:1787380325.387871:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915594240 00000100:00100000:0.0:1787380325.387875:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915594240 00000100:00100000:0.0:1787380325.387899:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:0.0:1787380325.387916:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915594624:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380325.389533:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:1.0:1787380325.389549:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874203915594240:12345-192.168.206.14@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787380325.389632:0:5786:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 95d22c36-51bc-485d-88b7-d90632ec1801@192.168.206.14@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:1.0:1787380325.389704:0:5786:0:(genops.c:1406:class_connect()) connect: client 95d22c36-51bc-485d-88b7-d90632ec1801, cookie 0x651a07d1188424d0 00000004:00100000:1.0:1787380325.389747:0:5786:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787380325.391009:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915594624:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 3087us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380325.391025:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00080000:1.0:1787380325.391841:0:5786:0:(import.c:65:import_set_state_nolock()) ffff9d9688ff1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380325.391887:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+6:2352:x1874203915594240:12345-192.168.206.14@tcp:38:mount.lustre.0 Request processed in 2338us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.391897:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00080000:2.0:1787380325.391918:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380325.402810:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380325.402869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380325.402983:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915594496 00000100:00100000:1.0:1787380325.402998:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915594496 00000100:00100000:2.0:1787380325.403002:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915594368 00000100:00100000:2.0:1787380325.403028:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915594368 00000100:00100000:1.0:1787380325.403090:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:1.0:1787380325.403103:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+7:8106:x1874203915594496:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787380325.403148:0:7761:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787380325.403282:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+7:8106:x1874203915594496:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 181us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.403289:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00080000:3.0:1787380325.404556:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380325.406712:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380325.411675:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915594752 00000100:00100000:3.0:1787380325.411691:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915594752 00000100:00100000:3.0:1787380325.412119:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1787380325.412131:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+7:0:x1874203915594368:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380325.412167:0:5787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787380325.412272:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+7:0:x1874203915594368:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 142us (9401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.412279:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1787380325.412299:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:3.0:1787380325.412306:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:8106:x1874203915594752:12345-192.168.206.14@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787380325.412334:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:8106:x1874203915594752:12345-192.168.206.14@tcp:40:mount.lustre.0 Request processed in 29us (5631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380325.412372:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:1.0:1787380325.417718:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380325.417757:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380325.417800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380325.417802:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595136 00000100:00100000:0.0:1787380325.417813:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595136 00000100:00100000:1.0:1787380325.417832:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915594880 00000100:00100000:1.0:1787380325.417848:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915594880 00000100:00100000:0.0:1787380325.417865:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:1.0:1787380325.417876:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595008 00000100:00100000:0.0:1787380325.417878:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d22c36-51bc-485d-88b7-d90632ec1801+6:8106:x1874203915595136:12345-192.168.206.14@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787380325.417879:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595008 00000100:00100000:1.0:1787380325.417898:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:1.0:1787380325.417905:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874203915594880:12345-192.168.206.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787380325.417929:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 95d22c36-51bc-485d-88b7-d90632ec1801@192.168.206.14@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:1.0:1787380325.417955:0:6576:0:(genops.c:1406:class_connect()) connect: client 95d22c36-51bc-485d-88b7-d90632ec1801, cookie 0x651a07d1188424d7 00002000:00100000:1.0:1787380325.417965:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95d22c36-51bc-485d-88b7-d90632ec1801/ffff9d9688ff0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380325.418086:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:0.0:1787380325.418326:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:1.0:1787380325.418412:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787380325.418442:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9d9688ff2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380325.418503:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d22c36-51bc-485d-88b7-d90632ec1801+6:2352:x1874203915594880:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 597us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380325.418505:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95d22c36-51bc-485d-88b7-d90632ec1801+6:8106:x1874203915595136:12345-192.168.206.14@tcp:33:mount.lustre.0 Request processed in 629us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.418516:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:0.0:1787380325.418520:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:1.0:1787380325.418538:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:1.0:1787380325.418544:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874203915595008:12345-192.168.206.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787380325.418583:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 95d22c36-51bc-485d-88b7-d90632ec1801@192.168.206.14@tcp t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:1.0:1787380325.418603:0:6576:0:(genops.c:1406:class_connect()) connect: client 95d22c36-51bc-485d-88b7-d90632ec1801, cookie 0x651a07d1188424de 00002000:00100000:1.0:1787380325.418609:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95d22c36-51bc-485d-88b7-d90632ec1801/ffff9d9688ff6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380325.418615:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380325.418729:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787380325.418745:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9d9688ff7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380325.418770:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d22c36-51bc-485d-88b7-d90632ec1801+6:2352:x1874203915595008:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 225us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380325.418788:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:2.0:1787380325.623626:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935551488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380325.623708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380325.623891:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935551488 00000100:00100000:0.0:1787380325.623899:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935551488 00000100:00100000:0.0:1787380325.623952:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787380325.623961:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935551488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380325.623994:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380325.624045:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935551488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380325.624052:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787380325.624140:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5235880 x1874203935551488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380325.624156:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5235880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935551488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787380325.880248:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787380326.191076:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95d22c36-51bc-485d-88b7-d90632ec1801 00000001:00100000:3.0:1787380326.701981:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95d22c36-51bc-485d-88b7-d90632ec1801 00010000:00010000:0.0:1787380326.912158:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787380327.232904:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95d22c36-51bc-485d-88b7-d90632ec1801 00010000:00010000:2.0:1787380327.928650:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380328.963266:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380329.209097:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935551616:0@lo:400:kworker.0 00000100:00100000:2.0:1787380329.209169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380329.209224:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935552128:0@lo:400:kworker.0 00000100:00100000:2.0:1787380329.209298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380329.209323:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380329.209367:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935552000:0@lo:400:kworker.0 00000100:00100000:2.0:1787380329.209398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380329.209424:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935551872:0@lo:400:kworker.0 00000100:00100000:2.0:1787380329.209448:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380329.209464:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787380329.209470:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935551744:0@lo:400:kworker.0 00000100:00100000:2.0:1787380329.209491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380329.209506:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935552256:0@lo:400:kworker.0 00000100:00100000:2.0:1787380329.209526:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380329.210239:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552128 00000100:00100000:3.0:1787380329.210252:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552128 00000100:00100000:3.0:1787380329.210327:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935551872 00000100:00100000:3.0:1787380329.210331:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935551872 00000100:00100000:3.0:1787380329.210368:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935551744 00000100:00100000:3.0:1787380329.210372:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935551744 00000100:00100000:3.0:1787380329.210388:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380329.210396:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935552128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380329.210463:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935552128:12345-0@lo:400:kworker.0 Request processed in 67us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.210470:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380329.210486:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380329.210492:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935551872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380329.210523:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935551872:12345-0@lo:400:kworker.0 Request processed in 32us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.210529:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380329.210540:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787380329.210546:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935551744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380329.210585:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935551744:12345-0@lo:400:kworker.0 Request processed in 40us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.210601:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787380329.210641:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935551744:0@lo:400:kworker.0 00000100:00100000:3.0:1787380329.210652:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935551872:0@lo:400:kworker.0 00000100:00100000:3.0:1787380329.210693:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935552128:0@lo:400:kworker.0 00000100:00100000:0.0:1787380329.210770:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935551616 00000100:00100000:0.0:1787380329.210775:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935551616 00000100:00100000:0.0:1787380329.210811:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787380329.210818:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935551616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380329.210854:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935551616:12345-0@lo:400:kworker.0 Request processed in 37us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380329.210860:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787380329.210960:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552000 00000100:00100000:1.0:1787380329.210965:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552000 00000100:00100000:1.0:1787380329.211002:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552256 00000100:00100000:1.0:1787380329.211005:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552256 00000100:00100000:1.0:1787380329.211027:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380329.211034:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935552000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380329.211079:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935552000:12345-0@lo:400:kworker.0 Request processed in 45us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380329.211085:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380329.211097:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787380329.211102:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935552256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380329.211133:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935552256:12345-0@lo:400:kworker.0 Request processed in 31us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380329.211139:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787380329.211172:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5237800 x1874203935552256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380329.211183:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935552256:0@lo:400:kworker.0 00010000:00080000:3.0:1787380329.211498:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5234000 x1874203935552000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380329.211508:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935552000:0@lo:400:kworker.0 00000100:00100000:3.0:1787380329.211517:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935551616:0@lo:400:kworker.0 00000100:00080000:2.0:1787380329.211589:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380329.211593:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380329.211596:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380329.721379:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380329.721402:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935552384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380329.721479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380329.722362:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552384 00000100:00100000:1.0:1787380329.722372:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552384 00000100:00100000:1.0:1787380329.722433:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787380329.722443:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935552384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380329.722477:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380329.722540:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935552384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380329.722547:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787380329.722710:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5230700 x1874203935552384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380329.722730:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5230700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935552384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380329.976384:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380330.574214:0:10156:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787380330.745594:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935552512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380330.745676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.745791:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552512 00000100:00100000:1.0:1787380330.745799:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552512 00000100:00100000:1.0:1787380330.745848:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787380330.745858:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935552512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380330.745903:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380330.752706:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935552512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6840us (7020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.752720:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787380330.759513:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5120700 x1874203935552512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380330.759539:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935552512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380330.866584:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380330.866643:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380330.866674:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380330.866713:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380330.866744:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380330.866808:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595520 00000100:00100000:3.0:1787380330.866817:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595520 00000100:00100000:3.0:1787380330.866883:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595392 00000100:00100000:3.0:1787380330.866886:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595392 00000100:00100000:3.0:1787380330.866910:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:3.0:1787380330.866917:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915595520:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380330.867034:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915595520:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 116us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.867041:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:3.0:1787380330.867070:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:3.0:1787380330.867077:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915595392:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380330.867105:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915595392:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.867124:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:2.0:1787380330.867531:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595264 00000100:00100000:2.0:1787380330.867537:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595264 00000100:00100000:2.0:1787380330.867602:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 220 00000100:00100000:2.0:1787380330.867610:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915595264:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380330.867645:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915595264:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 36us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.867651:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 220 00000100:00080000:2.0:1787380330.867677:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380330.870122:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595776 00000100:00100000:0.0:1787380330.870134:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595776 00000100:00100000:0.0:1787380330.870272:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595648 00000100:00100000:0.0:1787380330.870277:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595648 00000100:00100000:3.0:1787380330.870348:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:3.0:1787380330.870361:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915595776:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380330.870434:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915595776:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 76us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.870442:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00080000:2.0:1787380330.876064:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380330.876074:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380330.877630:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:0.0:1787380330.877648:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915595648:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380330.877729:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915595648:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 87us (10984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380330.877736:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 41 00010000:00010000:0.0:1787380331.003687:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380332.023908:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380333.047477:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380334.072251:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380334.328652:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935552768:0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.328722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380334.328769:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935553280:0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.328801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380334.328832:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380334.328839:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935552896:0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.328861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380334.328897:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552768 00000100:00100000:0.0:1787380334.328903:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552768 00000100:00100000:0.0:1787380334.328940:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552896 00000100:00100000:0.0:1787380334.328943:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552896 00000100:00100000:0.0:1787380334.328968:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787380334.328975:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935552768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.329025:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935552768:12345-0@lo:400:kworker.0 Request processed in 49us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380334.329032:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787380334.329048:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787380334.329054:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935552896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.329079:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935552896:12345-0@lo:400:kworker.0 Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380334.329084:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787380334.329102:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553280 00000100:00100000:0.0:1787380334.329105:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553280 00000100:00100000:0.0:1787380334.329132:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787380334.329138:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935553280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.329178:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935553280:12345-0@lo:400:kworker.0 Request processed in 41us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380334.329185:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787380334.329421:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935552896:0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.329432:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935552768:0@lo:400:kworker.0 00010000:00080000:0.0:1787380334.329442:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5235f80 x1874203935553280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380334.329453:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935553280:0@lo:400:kworker.0 00000100:00100000:1.0:1787380334.329553:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935553024:0@lo:400:kworker.0 00000100:00100000:1.0:1787380334.329583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380334.329612:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380334.329618:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935552640:0@lo:400:kworker.0 00000100:00100000:1.0:1787380334.329643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380334.329668:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935553152:0@lo:400:kworker.0 00000100:00100000:1.0:1787380334.329690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380334.329715:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553152 00000100:00100000:1.0:1787380334.329719:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553152 00000100:00100000:1.0:1787380334.329749:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380334.329756:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935553152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380334.329789:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935553152:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380334.329806:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380334.329826:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935552640 00000100:00100000:1.0:1787380334.329829:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935552640 00000100:00100000:1.0:1787380334.329849:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787380334.329854:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935552640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380334.329881:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935552640:12345-0@lo:400:kworker.0 Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380334.329886:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787380334.329911:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935552640:0@lo:400:kworker.0 00000100:00100000:1.0:1787380334.329920:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935553152:0@lo:400:kworker.0 00000100:00080000:2.0:1787380334.330003:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380334.330008:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380334.330416:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553024 00000100:00100000:0.0:1787380334.330421:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553024 00000100:00100000:0.0:1787380334.330469:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787380334.330477:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935553024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380334.330521:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935553024:12345-0@lo:400:kworker.0 Request processed in 45us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380334.330538:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787380334.330602:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5235500 x1874203935553024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380334.330624:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935553024:0@lo:400:kworker.0 00000100:00080000:2.0:1787380334.330757:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380334.841217:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935553408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380334.841283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380334.841368:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553408 00000100:00100000:0.0:1787380334.841375:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553408 00000100:00100000:0.0:1787380334.841420:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380334.841429:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935553408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380334.841462:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380334.841504:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5237100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935553408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380334.841536:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787380334.841579:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5235f80 x1874203935553408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380334.841596:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5235f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935553408:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380335.098620:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380335.866215:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935553536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380335.866286:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380335.866476:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553536 00000100:00100000:2.0:1787380335.866484:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553536 00000100:00100000:2.0:1787380335.866547:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380335.866557:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935553536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380335.866592:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380335.866643:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935553536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380335.866649:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787380335.866688:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5123100 x1874203935553536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380335.866705:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935553536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380335.991316:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380335.991392:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380335.991432:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380335.991442:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596288 00000100:00100000:3.0:1787380335.991452:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596288 00000100:00100000:0.0:1787380335.991460:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380335.991499:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380335.991559:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596032 00000100:00100000:1.0:1787380335.991564:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596032 00000100:00100000:1.0:1787380335.991592:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596160 00000100:00100000:1.0:1787380335.991594:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596160 00000100:00100000:1.0:1787380335.991613:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 74 00000100:00100000:1.0:1787380335.991622:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915596032:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380335.991691:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915596032:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 70us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380335.991698:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 74 00000100:00100000:1.0:1787380335.991721:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 75 00000100:00100000:1.0:1787380335.991727:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596160:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380335.991755:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596160:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380335.991761:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 75 00000100:00080000:2.0:1787380335.992059:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380335.992065:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380335.992199:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915595904 00000100:00100000:1.0:1787380335.992205:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915595904 00000100:00100000:1.0:1787380335.992232:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 222 00000100:00100000:1.0:1787380335.992238:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915595904:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380335.992268:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915595904:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 30us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380335.992275:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 222 00000100:00100000:3.0:1787380335.997568:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596416 00000100:00100000:3.0:1787380335.997582:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596416 00000100:00100000:1.0:1787380335.997591:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:1.0:1787380335.997604:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596288:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380335.997645:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:3.0:1787380335.997652:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596416:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380335.997680:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596288:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 80us (6288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380335.997685:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596416:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 35us (6188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380335.997688:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:3.0:1787380335.997691:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00080000:3.0:1787380335.997731:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787380336.130573:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380337.146468:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380338.168471:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380339.196548:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380339.449555:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935553792:0@lo:400:kworker.0 00000100:00100000:0.0:1787380339.449636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380339.449682:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935554304:0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.449696:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935554048:0@lo:400:kworker.0 00000100:00100000:0.0:1787380339.449707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380339.449736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380339.449738:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380339.449743:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935553920:0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.449756:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380339.449761:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935553664:0@lo:400:kworker.0 00000100:00100000:0.0:1787380339.449763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380339.449786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380339.449809:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935554176:0@lo:400:kworker.0 00000100:00100000:0.0:1787380339.449810:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553664 00000100:00100000:0.0:1787380339.449816:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553664 00000100:00100000:1.0:1787380339.449830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380339.449854:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787380339.449862:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935553664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.449869:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553792 00000100:00100000:1.0:1787380339.449872:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553792 00000100:00100000:1.0:1787380339.449900:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935553920 00000100:00100000:1.0:1787380339.449904:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935553920 00000100:00100000:0.0:1787380339.449905:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935553664:12345-0@lo:400:kworker.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380339.449912:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787380339.449922:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554176 00000100:00100000:1.0:1787380339.449924:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554176 00000100:00100000:1.0:1787380339.449937:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380339.449943:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935553792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.449986:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935553792:12345-0@lo:400:kworker.0 Request processed in 43us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380339.449992:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380339.450008:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380339.450014:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935553920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.450042:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935553920:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380339.450047:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787380339.450049:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935553792:0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.450058:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787380339.450063:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935554176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380339.450077:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935553920:0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.450085:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935554176:12345-0@lo:400:kworker.0 Request processed in 23us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380339.450091:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787380339.450108:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554304 00000100:00100000:1.0:1787380339.450111:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554304 00000100:00100000:1.0:1787380339.450145:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554048 00000100:00100000:1.0:1787380339.450148:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554048 00000100:00100000:1.0:1787380339.450165:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787380339.450171:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935554304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.450204:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935554304:12345-0@lo:400:kworker.0 Request processed in 34us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380339.450217:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787380339.450229:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787380339.450234:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935554048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.450263:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935554048:12345-0@lo:400:kworker.0 Request processed in 29us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380339.450268:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787380339.450299:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380339.450303:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380339.450305:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380339.450320:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935553664:0@lo:400:kworker.0 00000100:00100000:1.0:1787380339.450331:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935554176:0@lo:400:kworker.0 00010000:00080000:1.0:1787380339.450359:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5234000 x1874203935554048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380339.450369:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935554048:0@lo:400:kworker.0 00010000:00080000:1.0:1787380339.450396:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5236680 x1874203935554304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380339.450404:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935554304:0@lo:400:kworker.0 00000100:00100000:2.0:1787380339.959736:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935554432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380339.959817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380339.960011:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554432 00000100:00100000:0.0:1787380339.960019:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554432 00000100:00100000:0.0:1787380339.960074:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787380339.960084:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935554432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380339.960118:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380339.960170:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935554432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380339.960177:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787380339.960391:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5234e00 x1874203935554432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380339.960410:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935554432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380340.216277:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380340.985508:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380340.985641:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935554560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380340.985720:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380340.985889:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554560 00000100:00100000:2.0:1787380340.985897:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554560 00000100:00100000:2.0:1787380340.985955:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787380340.985965:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935554560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380340.986002:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380340.986075:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935554560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380340.986090:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787380340.986288:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5122a00 x1874203935554560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380340.986307:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935554560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380341.118709:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380341.118754:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380341.118774:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380341.118799:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380341.118828:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380341.118862:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596672 00000100:00100000:3.0:1787380341.118872:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596672 00000100:00100000:3.0:1787380341.118947:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596800 00000100:00100000:3.0:1787380341.118951:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596800 00000100:00100000:3.0:1787380341.118977:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:3.0:1787380341.118987:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915596672:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380341.119230:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915596672:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 242us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.119238:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:3.0:1787380341.119256:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:3.0:1787380341.119263:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596800:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380341.119288:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915596800:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.119294:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:3.0:1787380341.119322:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597056 00000100:00100000:3.0:1787380341.119326:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597056 00000100:00100000:2.0:1787380341.119680:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596544 00000100:00100000:2.0:1787380341.119686:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596544 00000100:00100000:2.0:1787380341.119723:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 224 00000100:00100000:2.0:1787380341.119731:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915596544:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380341.119761:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915596544:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 32us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.119767:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 224 00000100:00080000:2.0:1787380341.119901:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380341.119905:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380341.119914:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915596928 00000100:00100000:2.0:1787380341.119918:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915596928 00000100:00100000:3.0:1787380341.120800:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:3.0:1787380341.120813:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915597056:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380341.120857:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915597056:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 47us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.120863:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:2.0:1787380341.123752:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:2.0:1787380341.123771:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2355:x1874203915596928:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380341.123848:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2355:x1874203915596928:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 86us (5019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.123856:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00080000:2.0:1787380341.124079:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787380341.239526:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380342.268530:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380343.287578:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380344.311777:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380344.579387:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935555072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.579454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380344.579516:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380344.579523:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935554688:0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.579554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380344.579577:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935555200:0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.579612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380344.579640:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935554816:0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.579662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380344.579679:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935555328:0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.579700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380344.579716:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380344.579721:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935554944:0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.579739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380344.579768:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555072 00000100:00100000:1.0:1787380344.579775:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555072 00000100:00100000:1.0:1787380344.580014:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555328 00000100:00100000:1.0:1787380344.580018:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555328 00000100:00100000:3.0:1787380344.584943:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787380344.584962:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935555072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380344.585066:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935555072:12345-0@lo:400:kworker.0 Request processed in 110us (5612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380344.585075:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787380344.585096:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787380344.585104:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935555328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380344.585140:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935555328:12345-0@lo:400:kworker.0 Request processed in 38us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380344.585146:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787380344.585188:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e78380 x1874203935555328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380344.585201:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935555328:0@lo:400:kworker.0 00010000:00080000:2.0:1787380344.585381:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9688e7a300 x1874203935555072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380344.585392:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935555072:0@lo:400:kworker.0 00000100:00100000:0.0:1787380344.586786:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555200 00000100:00100000:1.0:1787380344.587004:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554816 00000100:00100000:1.0:1787380344.587010:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554816 00000100:00100000:1.0:1787380344.587058:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554944 00000100:00100000:1.0:1787380344.587061:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554944 00000100:00100000:1.0:1787380344.587081:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787380344.587090:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935554816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.587162:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935554816:12345-0@lo:400:kworker.0 Request processed in 73us (7498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380344.587169:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787380344.587185:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787380344.587191:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935554944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.587221:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935554944:12345-0@lo:400:kworker.0 Request processed in 31us (7480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380344.587226:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787380344.587242:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380344.587255:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380344.587258:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380344.587282:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935554688 00000100:00100000:1.0:1787380344.587287:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935554688 00000100:00100000:1.0:1787380344.587311:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787380344.587317:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935554688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380344.587371:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935554688:12345-0@lo:400:kworker.0 Request processed in 54us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380344.587377:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787380344.587539:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5232a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935554688:0@lo:400:kworker.0 00000100:00100000:3.0:1787380344.587669:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935554944:0@lo:400:kworker.0 00000100:00100000:3.0:1787380344.587681:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935554816:0@lo:400:kworker.0 00000100:00100000:0.0:1787380344.588937:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555200 00000100:00100000:0.0:1787380344.589012:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787380344.589022:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935555200:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787380344.589156:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380344.589228:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935555200:12345-0@lo:400:kworker.0 Request processed in 208us (9615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380344.589235:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787380344.591628:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935555200:0@lo:400:kworker.0 00000100:00100000:2.0:1787380345.080949:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380345.080972:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935555456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380345.081040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380345.081137:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555456 00000100:00100000:0.0:1787380345.081145:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555456 00000100:00100000:0.0:1787380345.081207:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787380345.081217:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935555456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380345.081247:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380345.081290:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935555456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380345.081308:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787380345.081373:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5234700 x1874203935555456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380345.081391:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935555456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380345.340389:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380346.103978:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380346.103999:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935555584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380346.104069:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380346.104174:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555584 00000100:00100000:0.0:1787380346.104181:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555584 00000100:00100000:0.0:1787380346.104240:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787380346.104249:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935555584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380346.104281:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380346.104325:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935555584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380346.104331:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787380346.104438:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380346.104482:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5234700 x1874203935555584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380346.104500:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935555584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380346.225773:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380346.225821:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380346.225845:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380346.225869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380346.225891:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380346.225894:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597184 00000100:00100000:2.0:1787380346.225903:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597184 00000100:00100000:3.0:1787380346.225926:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597312 00000100:00100000:3.0:1787380346.225929:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597312 00000100:00100000:2.0:1787380346.225952:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 226 00000100:00100000:2.0:1787380346.225960:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915597184:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380346.225962:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597440 00000100:00100000:3.0:1787380346.225965:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597440 00000100:00100000:3.0:1787380346.225984:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 84 00000100:00100000:3.0:1787380346.225990:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915597312:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380346.226094:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915597184:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380346.226102:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 226 00000100:00100000:0.0:1787380346.226177:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:0.0:1787380346.226186:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915597440:12345-192.168.206.14@tcp:400:kworker.0 00000100:00080000:1.0:1787380346.226271:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380346.226284:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597568 00000100:00100000:1.0:1787380346.226288:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597568 00000100:00100000:1.0:1787380346.226318:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597696 00000100:00100000:1.0:1787380346.226321:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597696 00000100:00100000:1.0:1787380346.226377:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:1.0:1787380346.226384:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2352:x1874203915597568:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:1.0:1787380346.226402:0:8465:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188424d7 00000100:00080000:1.0:1787380346.226409:0:8465:0:(import.c:65:import_set_state_nolock()) ffff9d9688ff2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380346.226441:0:8465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787380346.226958:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915597312:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 965us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.226967:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 84 00000100:00100000:3.0:1787380346.227161:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:3.0:1787380346.227171:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2352:x1874203915597696:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:3.0:1787380346.227728:0:6577:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188424de 00000100:00080000:3.0:1787380346.227738:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9d9688ff7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787380346.227771:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787380346.228176:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95d22c36-51bc-485d-88b7-d90632ec1801+2:2352:x1874203915597696:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 1004us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.228294:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00010000:00010000:3.0:1787380346.228320:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787380346.229156:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380346.229163:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787380346.229176:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380346.230952:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915597440:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 4758us (5095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380346.230967:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:1.0:1787380346.235138:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95d22c36-51bc-485d-88b7-d90632ec1801+2:2352:x1874203915597568:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 8742us (9255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380346.235153:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00010000:00010000:2.0:1787380346.359866:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787380346.717180:0:10857:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787380347.200504:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95d22c36-51bc-485d-88b7-d90632ec1801 00000020:00000080:3.0:1787380347.200514:0:7479:0:(genops.c:906:class_export_put()) final put ffff9d9688ff6800/95d22c36-51bc-485d-88b7-d90632ec1801 00000020:00000080:2.0:1787380347.200594:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9688ff6800/95d22c36-51bc-485d-88b7-d90632ec1801 for lustre-OST0001 00000020:00000080:2.0:1787380347.200648:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d9688ff7800 for lustre-OST0001 00010000:00010000:3.0:1787380347.385068:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787380347.737626:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95d22c36-51bc-485d-88b7-d90632ec1801 00000020:00000080:0.0:1787380347.737636:0:6603:0:(genops.c:906:class_export_put()) final put ffff9d9688ff0800/95d22c36-51bc-485d-88b7-d90632ec1801 00000020:00000080:0.0:1787380347.737674:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9688ff0800/95d22c36-51bc-485d-88b7-d90632ec1801 for lustre-OST0000 00000020:00000080:0.0:1787380347.737710:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d9688ff2800 for lustre-OST0000 00010000:00010000:0.0:1787380348.408431:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380349.434756:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380349.691686:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935556096:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.691772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380349.691823:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380349.691831:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935555712:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.691859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380349.691899:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935556224:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.691931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380349.691957:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935555968:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.691977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380349.691995:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787380349.692001:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935555840:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380349.692037:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935556352:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692056:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380349.692082:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935556096 00000100:00100000:1.0:1787380349.692103:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935556096 00000100:00100000:1.0:1787380349.692150:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935556352 00000100:00100000:1.0:1787380349.692153:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935556352 00000100:00100000:1.0:1787380349.692174:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380349.692182:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935556096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692230:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935556096:12345-0@lo:400:kworker.0 Request processed in 47us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380349.692237:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380349.692266:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380349.692273:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935556352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692301:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935556352:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380349.692307:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380349.692322:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935556224 00000100:00100000:1.0:1787380349.692325:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935556224 00000100:00100000:1.0:1787380349.692373:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555968 00000100:00100000:1.0:1787380349.692377:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555968 00000100:00100000:1.0:1787380349.692389:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555840 00000100:00100000:1.0:1787380349.692398:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555840 00000100:00100000:1.0:1787380349.692413:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787380349.692419:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935556224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692463:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935556224:12345-0@lo:400:kworker.0 Request processed in 44us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380349.692470:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787380349.692481:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787380349.692486:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935555968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692510:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935555968:12345-0@lo:400:kworker.0 Request processed in 24us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380349.692516:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787380349.692525:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787380349.692531:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935555840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692553:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935555840:12345-0@lo:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380349.692558:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787380349.692580:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380349.692585:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380349.692587:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380349.692616:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935556224:0@lo:400:kworker.0 00010000:00080000:1.0:1787380349.692629:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f35c00 x1874203935556096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380349.692639:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935556096:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692666:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935555840:0@lo:400:kworker.0 00010000:00080000:1.0:1787380349.692675:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f36a00 x1874203935556352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380349.692691:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935556352:0@lo:400:kworker.0 00000100:00100000:1.0:1787380349.692703:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935555968:0@lo:400:kworker.0 00000100:00100000:2.0:1787380349.695122:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935555712 00000100:00100000:2.0:1787380349.695135:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935555712 00000100:00100000:2.0:1787380349.695186:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787380349.695196:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935555712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380349.695294:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935555712:12345-0@lo:400:kworker.0 Request processed in 99us (3434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380349.695302:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787380349.703377:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935555712:0@lo:400:kworker.0 00000100:00100000:2.0:1787380350.200422:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcaf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935556480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380350.200499:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380350.200648:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935556480 00000100:00100000:3.0:1787380350.200656:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935556480 00000100:00100000:3.0:1787380350.200705:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787380350.200714:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935556480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380350.200743:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380350.200781:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935556480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380350.200788:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787380350.200849:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bcaf3100 x1874203935556480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380350.200865:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcaf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935556480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787380350.455908:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787380350.623862:0:11006:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdcb5587e0 00000020:00000080:1.0:1787380350.623877:0:11006:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787380350.623881:0:11006:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787380350.623889:0:11006:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdcb55aa70 20000000:00000080:1.0:1787380350.623895:0:11006:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d96b5d3dc00 uarg=0000000000000000 20000000:01000000:1.0:1787380350.623930:0:11006:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787380350.623935:0:11006:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787380350.623939:0:11006:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787380350.625551:0:11007:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787380350.629060:0:11006:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787380350.637482:0:11006:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787380350.637685:0:11006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637707:0:11006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637715:0:11006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842491 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637722:0:11006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884249f expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637729:0:11006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188424ad expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637737:0:11006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637745:0:11006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637787:0:11006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637801:0:11006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 12 pid: 5781 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380350.637831:0:11006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556608:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380350.637949:0:11006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188424ad expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.637958:0:11006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188424ad expref: 18 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380350.637967:0:11006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5122300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556736:0@lo:104: 00000100:00100000:2.0:1787380350.638002:0:11006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380350.638030:0:11006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d11884249f expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.638038:0:11006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d11884249f expref: 18 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380350.638045:0:11006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5120a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556864:0@lo:104: 00000100:00100000:2.0:1787380350.638063:0:11006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380350.638104:0:11006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842491 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.638112:0:11006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842491 expref: 18 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380350.638120:0:11006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5123b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556992:0@lo:104: 00000100:00100000:2.0:1787380350.638138:0:11006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380350.638158:0:11006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 12 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380350.638271:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935556736 00000100:00100000:3.0:1787380350.638278:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935556736 00000100:00100000:3.0:1787380350.638311:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935556864 00000100:00100000:3.0:1787380350.638314:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935556864 00000100:00100000:3.0:1787380350.638323:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935556992 00000100:00100000:3.0:1787380350.638325:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935556992 00000100:00100000:3.0:1787380350.638354:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380350.638363:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:11006:x1874203935556736:12345-0@lo:104: 00010000:00010000:3.0:1787380350.638374:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638427:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380350.638432:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:11006:x1874203935556736:12345-0@lo:104: Request processed in 71us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380350.638453:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380350.638469:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380350.638475:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:11006:x1874203935556864:12345-0@lo:104: 00010000:00010000:3.0:1787380350.638481:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638509:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380350.638513:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:11006:x1874203935556864:12345-0@lo:104: Request processed in 39us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380350.638518:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380350.638529:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380350.638535:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:11006:x1874203935556992:12345-0@lo:104: 00010000:00010000:3.0:1787380350.638541:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638562:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787380350.638567:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:11006:x1874203935556992:12345-0@lo:104: Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380350.638571:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787380350.638586:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787380350.638591:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638597:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380350.638607:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638615:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380350.638621:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380350.638627:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380350.638650:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638657:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380350.638676:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638682:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e600/0x651a07d1188424ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188424b4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638693:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380350.638697:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638703:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380350.638706:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638712:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380350.638729:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380350.638734:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380350.638747:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638753:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380350.638760:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638766:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d11884249f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188424a6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638774:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380350.638778:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638783:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f3c00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:3.0:1787380350.638785:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638791:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380350.638796:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380350.638801:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380350.638818:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638824:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380350.638839:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638845:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f3c00/0x651a07d118842491 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842498 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.638858:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380350.638859:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380350.638861:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380350.638872:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935557248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380350.638900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380350.638920:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380350.638926:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935557376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380350.638946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380350.638964:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935557504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380350.638983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380350.639009:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935557248 00000100:00100000:3.0:1787380350.639013:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935557248 00010000:00010000:3.0:1787380350.639028:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188424ad expref: 19 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380350.639045:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935557376 00000100:00100000:3.0:1787380350.639048:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935557376 00010000:00010000:3.0:1787380350.639057:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884249f expref: 20 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380350.639079:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935557504 00000100:00100000:3.0:1787380350.639082:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935557504 00010000:00010000:3.0:1787380350.639093:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842491 expref: 21 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380350.639104:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380350.639110:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+21:3301:x1874203935557248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380350.639119:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380350.639123:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188424ad expref: 21 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380350.639208:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380350.639223:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787380350.639239:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+21:3301:x1874203935557376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380350.639247:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380350.639251:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884249f expref: 21 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380350.639468:0:8292:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787380350.639475:0:8292:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1787380350.639634:0:11006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 12 pid: 5779 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380350.639647:0:11006:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935557120:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380350.639704:0:11006:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96991613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380350.639723:0:11006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5122300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556736:0@lo:104: 00000100:00100000:2.0:1787380350.639732:0:11006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5120a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556864:0@lo:104: 00000100:00100000:2.0:1787380350.639740:0:11006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5123b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556992:0@lo:104: 00000100:00100000:1.0:1787380350.640842:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380350.640855:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aaaa441-7de5-4747-b366-e84ba9a288bb+21:3299:x1874203935557504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380350.640870:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380350.640876:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842491 expref: 21 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.643890:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188424ad expref: 21 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.643914:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1f400/0x651a07d1188424b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188424ad expref: 21 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.643930:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380350.644004:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+20:3301:x1874203935557248:12345-0@lo:103:ldlm_bl.0 Request processed in 4893us (5102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380350.644014:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380350.644258:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380350.644303:0:11006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935556608:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380350.644323:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597824 00000100:00100000:2.0:1787380350.644328:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597824 00010000:00010000:2.0:1787380350.644371:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 13 pid: 5781 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380350.644399:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:2.0:1787380350.644408:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915597824:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380350.644419:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380350.644424:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 13 pid: 5781 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.644446:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 13 pid: 5781 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.644459:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af54600/0x651a07d1188424c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66bd expref: 13 pid: 5781 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.644483:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380350.644525:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:2356:x1874203915597824:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 117us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380350.644532:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1787380350.645040:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935557248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380350.646672:0:11006:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5120e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11006:1874203935557120:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380350.646706:0:11006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380350.647105:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d11884249f expref: 19 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380350.647126:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff3a00/0x651a07d1188424a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d11884249f expref: 19 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380350.647140:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380350.647395:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:3301:x1874203935557376:12345-0@lo:103:ldlm_bl.0 Request processed in 8158us (8447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380350.647411:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380350.647545:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935557376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380350.648384:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380350.648456:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915597952 00000100:00100000:3.0:1787380350.648471:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915597952 00010000:00010000:3.0:1787380350.648521:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 12 pid: 5779 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380350.648614:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:3.0:1787380350.648624:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:2356:x1874203915597952:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380350.648642:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380350.648649:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 12 pid: 5779 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.648661:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 12 pid: 5779 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.648682:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af54e00/0x651a07d11884248a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6685 expref: 12 pid: 5779 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.648700:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380350.648773:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2356:x1874203915597952:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 149us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380350.648781:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00010000:00010000:1.0:1787380350.650119:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842491 expref: 17 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380350.650144:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96813f3600/0x651a07d118842498 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842491 expref: 17 pid: 5779 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380350.650160:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380350.650319:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650537:0:8292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650546:0:8292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650552:0:8292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650577:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650583:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380350.650587:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650596:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650615:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380350.650625:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380350.650660:0:11006:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.650678:0:11006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380350.650685:0:11006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424e5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380350.650764:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3299:x1874203935557504:12345-0@lo:103:ldlm_bl.0 Request processed in 9910us (11776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380350.650776:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787380350.655997:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935557504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380351.231295:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935557632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380351.231392:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.231492:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935557632 00000100:00100000:2.0:1787380351.231501:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935557632 00000100:00100000:2.0:1787380351.231578:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787380351.231589:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935557632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380351.231624:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787380351.231804:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380351.232060:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935557632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 472us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.232068:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787380351.232186:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5234700 x1874203935557632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380351.232204:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935557632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380351.346621:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380351.347095:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598080 00000100:00100000:1.0:1787380351.347112:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598080 00000100:00100000:1.0:1787380351.347198:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 228 00000100:00100000:1.0:1787380351.347217:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2354:x1874203915598080:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380351.347312:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2354:x1874203915598080:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 104us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380351.347320:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 228 00000100:00100000:0.0:1787380351.356915:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380351.357092:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598336 00000100:00100000:1.0:1787380351.357107:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598336 00000100:00100000:1.0:1787380351.357315:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 89 00000100:00080000:0.0:1787380351.357325:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380351.357333:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915598336:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380351.357499:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915598336:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 173us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380351.357508:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 89 00000100:00100000:3.0:1787380351.358517:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380351.358620:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598208 00000100:00100000:1.0:1787380351.358628:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598208 00000100:00100000:1.0:1787380351.358780:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 90 00000100:00100000:1.0:1787380351.358789:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915598208:12345-192.168.206.14@tcp:400:kworker.0 00000100:00080000:2.0:1787380351.358856:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380351.367721:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915598208:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 8921us (9199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380351.367736:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 90 00010000:00010000:3.0:1787380351.481573:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380352.242292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380352.242592:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598464 00000100:00100000:2.0:1787380352.242602:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598464 00000100:00100000:2.0:1787380352.242680:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 229 00000100:00100000:2.0:1787380352.242690:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:5570:x1874203915598464:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380352.242718:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380352.242736:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f66e7 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380352.242762:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380352.242773:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380352.242781:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2800, rc 0) 00000100:00100000:2.0:1787380352.242837:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915598464:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 148us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380352.242844:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 229 00000100:00100000:1.0:1787380352.255243:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380352.259024:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598592 00000100:00100000:3.0:1787380352.259041:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598592 00000100:00100000:3.0:1787380352.259138:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 230 00000100:00100000:3.0:1787380352.259147:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915598592:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.259477:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915598592:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 330us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380352.259487:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 230 00000100:00100000:2.0:1787380352.265224:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380352.265725:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598720 00000100:00100000:1.0:1787380352.265736:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598720 00000100:00100000:1.0:1787380352.265785:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 231 00000100:00100000:1.0:1787380352.265794:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915598720:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380352.266149:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915598720:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 282us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380352.266159:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 231 00000100:00100000:3.0:1787380352.280624:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380352.281169:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598848 00000100:00100000:0.0:1787380352.281179:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598848 00000100:00100000:0.0:1787380352.281236:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 232 00000100:00100000:0.0:1787380352.281245:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915598848:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380352.281269:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380352.281285:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f66ee expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.281312:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.281335:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.281370:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e400, rc 0) 00000100:00100000:0.0:1787380352.281418:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915598848:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 174us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.281438:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 232 00000100:00100000:2.0:1787380352.285282:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380352.285404:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915598976 00000100:00100000:1.0:1787380352.285414:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915598976 00000100:00100000:1.0:1787380352.285467:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 233 00000100:00100000:1.0:1787380352.285476:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915598976:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380352.285720:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915598976:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 245us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380352.285727:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 233 00000100:00100000:0.0:1787380352.295671:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380352.296572:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915599104 00000100:00100000:1.0:1787380352.296585:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915599104 00000100:00100000:1.0:1787380352.296648:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 234 00000100:00100000:1.0:1787380352.296657:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915599104:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380352.296881:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915599104:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 223us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380352.296888:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 234 00010000:00010000:3.0:1787380352.506538:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380352.638756:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380352.638764:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d969f0ea800 from 7 10000000:01000000:3.0:1787380352.638768:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380352.638814:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.638826:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.638837:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380352.638860:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935557760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.638927:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380352.639007:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380352.642110:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935557760 00000100:00100000:2.0:1787380352.642124:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935557760 00000100:00100000:3.0:1787380352.644612:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787380352.644625:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935557760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380352.644643:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380352.644663:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188424fa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.644691:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188424fa expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.644712:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188424fa expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.644722:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55600, rc 0) 00000100:00100000:3.0:1787380352.644815:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935557760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (5887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380352.644821:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787380352.644902:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935557760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380352.644921:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380352.644930:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380352.644998:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5120000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380352.645031:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380352.652140:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935557888 00000100:00100000:0.0:1787380352.652155:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935557888 00000100:00100000:0.0:1787380352.652209:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787380352.652217:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935557888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.652516:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935557888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (7483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.652524:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787380352.655585:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b7e65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380352.655630:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5120000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.655693:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.655760:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380352.655788:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380352.655898:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558016 00000100:00100000:0.0:1787380352.655904:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558016 00000100:00100000:0.0:1787380352.655941:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787380352.655949:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935558016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.656117:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935558016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.656124:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787380352.656384:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787380352.657112:0:11064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787380352.657259:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787380352.657279:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380352.657290:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.657301:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380352.657312:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380352.657315:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96ba3b2800 from 7 10000000:01000000:3.0:1787380352.657317:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380352.657369:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.657393:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.657404:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380352.657421:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.657478:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380352.657507:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380352.657599:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558144 00000100:00100000:0.0:1787380352.657605:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558144 00000100:00100000:0.0:1787380352.657635:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787380352.657650:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935558144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380352.657661:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380352.657673:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842508 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.657696:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842508 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.657707:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842508 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.657717:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f800, rc 0) 00000100:00100000:0.0:1787380352.657753:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935558144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.657759:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787380352.657846:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380352.657860:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.657869:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380352.657915:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.657937:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380352.657962:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380352.658004:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558272 00000100:00100000:0.0:1787380352.658008:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558272 00000100:00100000:0.0:1787380352.658036:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787380352.658042:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935558272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.658248:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935558272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.658255:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787380352.658325:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.658378:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.658413:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380352.658442:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380352.661438:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558400 00000100:00100000:0.0:1787380352.661451:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558400 00000100:00100000:0.0:1787380352.661501:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787380352.661510:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935558400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.661720:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935558400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (3305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.661734:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787380352.661875:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787380352.662474:0:11065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787380352.662529:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787380352.662547:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380352.662557:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.662568:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380352.662577:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380352.662580:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d968b549800 from 7 10000000:01000000:3.0:1787380352.662583:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380352.662612:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.662620:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380352.662629:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380352.662649:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380352.662687:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380352.662715:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380352.662844:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558528 00000100:00100000:0.0:1787380352.662848:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558528 00000100:00100000:0.0:1787380352.662881:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787380352.662888:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935558528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380352.662899:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380352.662911:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842516 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.662930:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842516 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.662941:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842516 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.662950:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1fa00, rc 0) 00000100:00100000:0.0:1787380352.662985:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935558528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.662991:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787380352.663026:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380352.663037:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.663046:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380352.663085:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.663117:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380352.663134:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380352.663145:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558656 00000100:00100000:0.0:1787380352.663148:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558656 00000100:00100000:0.0:1787380352.663163:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787380352.663168:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935558656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.663385:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935558656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.663391:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787380352.663418:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.663459:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.663494:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380352.663511:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380352.663522:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558784 00000100:00100000:0.0:1787380352.663525:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558784 00000100:00100000:0.0:1787380352.663542:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787380352.663546:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935558784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380352.663663:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935558784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.663670:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787380352.663704:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935558784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787380352.664222:0:11066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787380352.664262:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787380352.664275:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380352.664282:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380352.664297:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380353.527512:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380354.553469:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380354.809371:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935559168:0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.809454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380354.809511:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380354.809517:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935559296:0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.809542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380354.809582:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559168 00000100:00100000:0.0:1787380354.809588:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559168 00000100:00100000:3.0:1787380354.809773:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935558912:0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.809955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380354.809980:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935559424:0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.810005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380354.810025:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787380354.810031:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935559040:0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.810072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380354.810089:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935559552:0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.810109:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380354.810213:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559424 00000100:00100000:3.0:1787380354.810218:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559424 00000100:00100000:3.0:1787380354.810256:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559040 00000100:00100000:3.0:1787380354.810260:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559040 00000100:00100000:3.0:1787380354.810276:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787380354.810283:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935559424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.810331:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935559424:12345-0@lo:400:kworker.0 Request processed in 47us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380354.810359:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787380354.810375:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787380354.810381:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.810408:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935559040:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380354.810426:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787380354.810448:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559296 00000100:00100000:3.0:1787380354.810451:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559296 00000100:00100000:3.0:1787380354.810476:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559552 00000100:00100000:3.0:1787380354.810479:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559552 00000100:00100000:3.0:1787380354.810496:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787380354.810502:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935559296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.810535:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935559296:12345-0@lo:400:kworker.0 Request processed in 33us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380354.810541:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787380354.810551:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787380354.810564:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935559552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380354.810593:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935559552:12345-0@lo:400:kworker.0 Request processed in 29us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380354.810599:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380354.811228:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787380354.811238:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935559168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.811277:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935559168:12345-0@lo:400:kworker.0 Request processed in 42us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380354.811283:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1787380354.811304:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380354.811308:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380354.811310:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380354.811320:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935558912 00000100:00100000:0.0:1787380354.811324:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935558912 00000100:00100000:0.0:1787380354.811362:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787380354.811369:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935558912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.811398:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935558912:12345-0@lo:400:kworker.0 Request processed in 30us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380354.811404:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00080000:0.0:1787380354.811473:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5236d80 x1874203935559296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380354.811486:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935559296:0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.811495:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935559168:0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.814992:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935559040:0@lo:400:kworker.0 00010000:00080000:0.0:1787380354.815016:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd43d500 x1874203935559552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380354.815028:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935559552:0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.815039:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935558912:0@lo:400:kworker.0 00000100:00100000:0.0:1787380354.815051:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935559424:0@lo:400:kworker.0 00000100:00100000:2.0:1787380355.329211:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcaf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935559680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380355.329282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380355.329366:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559680 00000100:00100000:2.0:1787380355.329374:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559680 00000100:00100000:2.0:1787380355.329426:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787380355.329435:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935559680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380355.329469:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380355.329511:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935559680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380355.329517:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787380355.329568:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bcaf2a00 x1874203935559680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380355.329584:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcaf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935559680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380355.590147:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380355.680883:0:11205:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787380356.343819:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380356.343841:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935559808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380356.343905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.344106:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559808 00000100:00100000:0.0:1787380356.344113:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559808 00000100:00100000:0.0:1787380356.344177:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787380356.344187:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935559808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380356.344217:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380356.344266:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935559808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.344272:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787380356.344522:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787380356.344548:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd43d500 x1874203935559808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380356.344564:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935559808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380356.476578:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380356.476631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380356.476671:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380356.476836:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915599360 00000100:00100000:3.0:1787380356.476847:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915599360 00000100:00100000:3.0:1787380356.476913:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915599488 00000100:00100000:3.0:1787380356.476916:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915599488 00000100:00100000:3.0:1787380356.476950:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 94 00000100:00100000:3.0:1787380356.476960:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915599360:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380356.477029:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915599360:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 71us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.477037:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 94 00000100:00100000:3.0:1787380356.477054:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 95 00000100:00100000:3.0:1787380356.477060:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915599488:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380356.477084:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915599488:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.477090:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 95 00000100:00100000:2.0:1787380356.478116:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915599232 00000100:00100000:2.0:1787380356.478126:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915599232 00000100:00100000:2.0:1787380356.478183:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 245 00000100:00100000:2.0:1787380356.478192:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915599232:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380356.478246:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915599232:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 55us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380356.478263:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 245 00000100:00080000:1.0:1787380356.478621:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787380356.599593:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380357.623593:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380358.656311:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380359.672241:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380359.932655:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935560192:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.932721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380359.932774:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380359.932781:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935560320:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.932806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380359.932836:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935560064:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.932871:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380359.932891:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935560576:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.932911:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380359.932933:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787380359.932938:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935559936:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.932964:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380359.932985:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935560448:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933005:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380359.933034:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560192 00000100:00100000:3.0:1787380359.933040:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560192 00000100:00100000:3.0:1787380359.933088:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560064 00000100:00100000:3.0:1787380359.933091:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560064 00000100:00100000:3.0:1787380359.933104:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560448 00000100:00100000:3.0:1787380359.933106:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560448 00000100:00100000:3.0:1787380359.933123:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787380359.933132:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935560192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933182:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935560192:12345-0@lo:400:kworker.0 Request processed in 50us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380359.933188:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787380359.933204:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787380359.933209:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933238:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935560064:12345-0@lo:400:kworker.0 Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380359.933243:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787380359.933262:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787380359.933268:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935560448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933308:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935560448:12345-0@lo:400:kworker.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380359.933314:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787380359.933331:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560320 00000100:00100000:3.0:1787380359.933360:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560320 00000100:00100000:3.0:1787380359.933397:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560576 00000100:00100000:3.0:1787380359.933400:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560576 00000100:00100000:3.0:1787380359.933420:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787380359.933426:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935560320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933455:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935560320:12345-0@lo:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380359.933461:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787380359.933472:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787380359.933476:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935560576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933502:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935560576:12345-0@lo:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380359.933508:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787380359.933531:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935559936 00000100:00100000:3.0:1787380359.933534:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935559936 00000100:00100000:3.0:1787380359.933559:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787380359.933565:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935559936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933592:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935559936:12345-0@lo:400:kworker.0 Request processed in 28us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380359.933598:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00080000:3.0:1787380359.933651:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d95865a2d80 x1874203935560320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380359.933677:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935560320:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933691:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935560192:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933719:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935559936:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933729:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935560448:0@lo:400:kworker.0 00000100:00100000:3.0:1787380359.933736:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935560064:0@lo:400:kworker.0 00010000:00080000:3.0:1787380359.933745:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d95865a3100 x1874203935560576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380359.933753:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935560576:0@lo:400:kworker.0 00000100:00080000:1.0:1787380359.933870:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380359.933875:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380359.933877:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787380360.354783:0:11306:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:32:38 (1787380358) === 00000100:00100000:3.0:1787380360.441574:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380360.441594:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935560704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380360.441656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380360.441713:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560704 00000100:00100000:3.0:1787380360.441720:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560704 00000100:00100000:3.0:1787380360.441763:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787380360.441771:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935560704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380360.441801:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380360.441843:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935560704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.441849:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787380360.441890:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d95865a3100 x1874203935560704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380360.441907:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935560704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380360.653814:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380360.653855:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380360.653961:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915599744 00000100:00100000:1.0:1787380360.653971:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915599744 00000100:00100000:1.0:1787380360.654040:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1787380360.654050:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:9659:x1874203915599744:12345-192.168.206.14@tcp:700:mkdir.0 00000100:00100000:1.0:1787380360.654126:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:9659:x1874203915599744:12345-192.168.206.14@tcp:700:mkdir.0 Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380360.654133:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00080000:2.0:1787380360.654330:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380360.654438:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915599616 00000100:00100000:3.0:1787380360.654443:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915599616 00000100:00100000:3.0:1787380360.654483:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1787380360.654490:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915599616:12345-192.168.206.14@tcp:41:mkdir.0 00000004:00000024:3.0:1787380360.654515:0:5788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787380360.654617:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915599616:12345-192.168.206.14@tcp:41:mkdir.0 Request processed in 128us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.654623:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:0.0:1787380360.657050:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.657179:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915600000 00000100:00100000:3.0:1787380360.657188:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915600000 00000100:00100000:3.0:1787380360.657249:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:3.0:1787380360.657258:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:9659:x1874203915600000:12345-192.168.206.14@tcp:36:mkdir.0 00010000:00010000:3.0:1787380360.657306:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380360.657331:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842405 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6670 expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.657397:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727ff00) 00010000:00010000:3.0:1787380360.657407:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380360.657696:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.657708:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.657717:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.657772:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.657787:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.657794:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380360.659532:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787380360.659546:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.659554:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.659561:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.659567:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380360.659571:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.659578:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.659590:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380360.659593:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.659597:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.659603:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842524 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380360.659619:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a6d2a258 reply state 000000005be9358c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380360.659632:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380360.659724:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9659:x1874203915600000:12345-192.168.206.14@tcp:36:mkdir.0 Request processed in 2464us (2678us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787380360.659732:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00010000:00010000:2.0:1787380360.665806:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.665823:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.665831:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.665836:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380360.665841:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.665848:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.665888:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d968727f400) 00010000:00010000:2.0:1787380360.665892:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380360.665896:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.665902:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d11884252b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380360.671878:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.671953:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915600128 00000100:00100000:3.0:1787380360.671963:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915600128 00000100:00100000:3.0:1787380360.672022:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:3.0:1787380360.672032:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:9660:x1874203915600128:12345-192.168.206.14@tcp:101:chmod.0 00010000:00010000:3.0:1787380360.672052:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.672073:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f66f5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.672133:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842539 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.672145:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.672155:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380360.672208:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787380360.672212:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380360.672250:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842539 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.672291:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66f5 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.672327:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842539 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66f5 expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.672488:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380360.672492:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380360.672496:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54c00, rc 0) 00000100:00100000:3.0:1787380360.672544:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9660:x1874203915600128:12345-192.168.206.14@tcp:101:chmod.0 Request processed in 514us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.672551:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:1.0:1787380360.674776:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380360.674862:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915600384 00000100:00100000:0.0:1787380360.674870:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915600384 00000100:00100000:0.0:1787380360.674926:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:0.0:1787380360.674936:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9660:x1874203915600384:12345-192.168.206.14@tcp:36:chmod.0 00010000:00010000:0.0:1787380360.674983:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380360.675008:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118842539 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66f5 expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.675025:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380360.675035:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380360.675058:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.675070:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.675078:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380360.675635:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ea62c3b reply state 000000002a9a4e9a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380360.675646:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787380360.675661:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787380360.675797:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:9660:x1874203915600384:12345-192.168.206.14@tcp:36:chmod.0 Request processed in 861us (1027us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787380360.675805:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00010000:00010000:0.0:1787380360.683516:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.683545:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.683553:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.683559:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380360.683563:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.683590:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.683606:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96991e8f00) 00010000:00010000:0.0:1787380360.683610:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787380360.683615:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.683621:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842540 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.696618:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380360.709276:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.709557:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915600512 00000100:00100000:3.0:1787380360.709566:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915600512 00000100:00100000:3.0:1787380360.709641:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:3.0:1787380360.709651:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9661:x1874203915600512:12345-192.168.206.14@tcp:101:chown.0 00010000:00010000:3.0:1787380360.709673:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.709693:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f66fc expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.709754:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d11884254e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.709767:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d11884254e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.709780:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d11884254e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380360.709835:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787380360.709851:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380360.709893:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d11884254e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.709919:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66fc expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.709936:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d11884254e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66fc expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.709945:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727ff00) 00010000:00010000:3.0:1787380360.709948:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380360.709952:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54c00, rc 0) 00000100:00100000:3.0:1787380360.710014:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:9661:x1874203915600512:12345-192.168.206.14@tcp:101:chown.0 Request processed in 365us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.710022:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:1.0:1787380360.713739:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.713836:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915600640 00000100:00100000:3.0:1787380360.713845:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915600640 00000100:00100000:3.0:1787380360.713905:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1787380360.713915:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:9661:x1874203915600640:12345-192.168.206.14@tcp:101:chown.0 00010000:00010000:3.0:1787380360.713934:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.713952:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6703 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714013:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714025:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714052:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714068:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714075:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714081:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714177:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d11884256a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714185:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d11884256a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714192:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d11884256a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380360.714230:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787380360.714234:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380360.714256:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d11884256a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714274:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714280:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714295:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714301:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380360.714304:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714311:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714322:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727ff00) 00010000:00010000:3.0:1787380360.714325:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.714329:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714335:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884255c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714396:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714403:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714409:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714414:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380360.714417:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714434:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714442:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d968727fc00) 00010000:00010000:3.0:1787380360.714444:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.714447:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714453:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714486:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6703 expref: 10 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714499:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d11884256a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6703 expref: 9 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.714506:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:3.0:1787380360.714509:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380360.714511:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b800, rc 0) 00000100:00100000:3.0:1787380360.714561:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:9661:x1874203915600640:12345-192.168.206.14@tcp:101:chown.0 Request processed in 647us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.714567:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:1.0:1787380360.725413:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.725501:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915600896 00000100:00100000:3.0:1787380360.725510:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915600896 00000100:00100000:3.0:1787380360.725562:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:3.0:1787380360.725589:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:9661:x1874203915600896:12345-192.168.206.14@tcp:36:chown.0 00010000:00010000:3.0:1787380360.725641:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380360.725678:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d11884256a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6703 expref: 9 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.725697:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:3.0:1787380360.725708:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380360.725731:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.725744:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.725754:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380360.768453:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1787380360.768471:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787380360.768914:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dae73de reply state 00000000df61d0f0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380360.768927:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787380360.769072:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787380360.769167:0:5788:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787380360.769182:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9661:x1874203915600896:12345-192.168.206.14@tcp:36:chown.0 Request processed in 43609us (43776us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787380360.769191:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00010000:00010000:0.0:1787380360.775433:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.775460:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.775468:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.775491:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163aa00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380360.775496:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.775504:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.775520:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968727f800) 00010000:00010000:0.0:1787380360.775523:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787380360.775527:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.775534:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d118842571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380360.787938:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.788052:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915601024 00000100:00100000:3.0:1787380360.788062:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915601024 00000100:00100000:3.0:1787380360.788122:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:3.0:1787380360.788132:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:9662:x1874203915601024:12345-192.168.206.14@tcp:101:touch.500 00010000:00010000:3.0:1787380360.788155:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.788175:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d118842578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f670a expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380360.793986:0:7761:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5745us 00010000:00010000:1.0:1787380360.813611:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.813635:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.813646:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.813661:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.813668:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.813685:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814114:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3c00/0x651a07d11884258d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814124:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3c00/0x651a07d11884258d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814132:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3c00/0x651a07d11884258d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380360.814210:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787380360.814214:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380360.814321:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3c00/0x651a07d11884258d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814365:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814373:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814389:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814395:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f3400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380360.814399:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814406:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814424:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727ff00) 00010000:00010000:1.0:1787380360.814427:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380360.814431:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814437:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d11884257f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814449:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814454:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814458:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814463:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f2600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380360.814465:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814470:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814476:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d968911d900) 00010000:00010000:1.0:1787380360.814478:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380360.814480:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814485:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d118842586 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814532:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d118842578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f670a expref: 8 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814547:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3c00/0x651a07d11884258d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f670a expref: 7 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.814554:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:1.0:1787380360.814556:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787380360.814558:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96813f3c00, rc 0) 00000100:00100000:1.0:1787380360.814628:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9662:x1874203915601024:12345-192.168.206.14@tcp:101:touch.500 Request processed in 26497us (26698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380360.814637:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:1.0:1787380360.817514:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.817581:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915601280 00000100:00100000:3.0:1787380360.817598:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915601280 00000100:00100000:3.0:1787380360.817658:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:3.0:1787380360.817669:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9662:x1874203915601280:12345-192.168.206.14@tcp:101:touch.500 00010000:00010000:3.0:1787380360.817687:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.817705:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842594 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6711 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.818008:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.818021:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.818033:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.818072:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.818081:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.818087:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380360.818876:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787380360.819127:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188425a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819138:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188425a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819146:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188425a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819178:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819185:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819191:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819196:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380360.819201:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819208:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819219:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:3.0:1787380360.819222:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.819226:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819231:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a800/0x651a07d11884259b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380360.819255:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000827fb50f reply state 000000003e580b1c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380360.819264:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787380360.819294:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118842594 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6711 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819307:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188425a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6711 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.819315:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:3.0:1787380360.819318:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380360.819320:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b600, rc 0) 00000100:00100000:3.0:1787380360.819419:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:9662:x1874203915601280:12345-192.168.206.14@tcp:101:touch.500 Request processed in 1751us (1910us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787380360.819428:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00010000:00010000:3.0:1787380360.822417:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.822433:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.822439:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.822445:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380360.822449:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.822472:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.822487:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7740a54f (ffff9d968727fc00) 00010000:00010000:3.0:1787380360.822490:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.822494:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.822499:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b400/0x651a07d1188425a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380360.825217:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380360.825295:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915601536 00000100:00100000:0.0:1787380360.825304:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915601536 00000100:00100000:0.0:1787380360.825405:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:0.0:1787380360.825415:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:9662:x1874203915601536:12345-192.168.206.14@tcp:36:touch.500 00010000:00010000:0.0:1787380360.825469:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380360.825493:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188425a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6711 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.825512:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:0.0:1787380360.825522:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380360.825564:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.825576:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.825598:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380360.825718:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c846d01c reply state 00000000b9ac2ead transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380360.825726:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380360.825808:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:9662:x1874203915601536:12345-192.168.206.14@tcp:36:touch.500 Request processed in 394us (598us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787380360.825815:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:1.0:1787380360.829397:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.829579:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915601664 00000100:00100000:3.0:1787380360.829590:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915601664 00000100:00100000:3.0:1787380360.829651:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:3.0:1787380360.829661:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:9662:x1874203915601664:12345-192.168.206.14@tcp:101:touch.500 00010000:00010000:3.0:1787380360.829684:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.829702:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188425be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6718 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.829756:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188425be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6718 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.829770:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188425be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6718 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.829790:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d96991e8f00) 00010000:00010000:3.0:1787380360.829793:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380360.829797:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b200, rc 0) 00000100:00100000:3.0:1787380360.829867:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:9662:x1874203915601664:12345-192.168.206.14@tcp:101:touch.500 Request processed in 207us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.829873:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:3.0:1787380360.832520:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380360.833755:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915601792 00000100:00100000:2.0:1787380360.833766:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915601792 00000100:00100000:2.0:1787380360.833817:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:2.0:1787380360.833825:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874203915601792:12345-192.168.206.14@tcp:8:touch.500 00010000:00080000:2.0:1787380360.833870:0:6578:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:2.0:1787380360.833898:0:6578:0:(genops.c:1406:class_connect()) connect: client 7dca2b77-2f7d-460b-a508-1b61c3cf2401, cookie 0x651a07d1188425c5 00002000:00100000:2.0:1787380360.833910:0:6578:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7dca2b77-2f7d-460b-a508-1b61c3cf2401/ffff9d9698d8b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787380360.833933:0:6578:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787380360.834153:0:6578:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787380360.834181:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9d9698d8a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380360.834254:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2352:x1874203915601792:12345-192.168.206.14@tcp:8:touch.500 Request processed in 428us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380360.834261:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00010000:00010000:0.0:1787380360.834705:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.834716:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.834724:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.834730:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380360.834734:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.834741:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.834756:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d96991e8f00) 00010000:00010000:0.0:1787380360.834759:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380360.834763:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.834783:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380360.835964:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.836029:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915601920 00000100:00100000:3.0:1787380360.836038:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915601920 00000100:00100000:3.0:1787380360.836101:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:3.0:1787380360.836111:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:0:x1874203915601920:12345-192.168.206.14@tcp:2:touch.500 00000100:00080000:2.0:1787380360.836426:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380360.915985:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:0:x1874203915601920:12345-192.168.206.14@tcp:2:touch.500 Request processed in 79866us (80018us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787380360.915998:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000001:00100000:0.0:1787380360.916260:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000001:00080000:0.0:1787380360.916276:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1787380360.923375:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380360.923623:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915602176 00000100:00100000:0.0:1787380360.923633:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915602176 00000100:00100000:0.0:1787380360.923693:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:0.0:1787380360.923703:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:9662:x1874203915602176:12345-192.168.206.14@tcp:35:touch.500 00000100:00100000:0.0:1787380360.924041:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:9662:x1874203915602176:12345-192.168.206.14@tcp:35:touch.500 Request processed in 339us (707us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787380360.924050:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:2.0:1787380360.943767:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380360.943926:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915602304 00000100:00100000:0.0:1787380360.943935:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915602304 00000100:00100000:0.0:1787380360.943997:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:0.0:1787380360.944007:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:9663:x1874203915602304:12345-192.168.206.14@tcp:101:rm.0 00010000:00010000:0.0:1787380360.944029:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380360.944049:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f671f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.944105:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188425d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.944119:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188425d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.944130:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188425d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380360.944200:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787380360.944204:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380360.944240:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188425d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.944442:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188425cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f671f expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.944462:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188425d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f671f expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.944470:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:0.0:1787380360.944473:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380360.944476:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e600, rc 0) 00000100:00100000:0.0:1787380360.944575:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:9663:x1874203915602304:12345-192.168.206.14@tcp:101:rm.0 Request processed in 569us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380360.944582:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:2.0:1787380360.951526:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.951607:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915602560 00000100:00100000:3.0:1787380360.951616:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915602560 00000100:00100000:3.0:1787380360.951679:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:3.0:1787380360.951689:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:9663:x1874203915602560:12345-192.168.206.14@tcp:101:rm.0 00010000:00010000:3.0:1787380360.951710:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.951728:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d1188425da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6726 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380360.951833:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787380360.951984:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d1188425da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6726 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.951997:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727ff00) 00010000:00010000:3.0:1787380360.951999:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380360.952004:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d1188425da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6726 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.952024:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163ba00, rc 0) 00000100:00100000:3.0:1787380360.952083:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:9663:x1874203915602560:12345-192.168.206.14@tcp:101:rm.0 Request processed in 395us (566us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787380360.952090:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:2.0:1787380360.956286:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380360.956430:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915602688 00000100:00100000:0.0:1787380360.956439:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915602688 00000100:00100000:0.0:1787380360.956486:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:0.0:1787380360.956495:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:9663:x1874203915602688:12345-192.168.206.14@tcp:37:rm.0 00000100:00100000:0.0:1787380360.963765:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:9663:x1874203915602688:12345-192.168.206.14@tcp:37:rm.0 Request processed in 7261us (7478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380360.963779:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:3.0:1787380360.968143:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380360.968221:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915602944 00000100:00100000:1.0:1787380360.968230:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915602944 00000100:00100000:1.0:1787380360.968291:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:1.0:1787380360.968302:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e19c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:9663:x1874203915602944:12345-192.168.206.14@tcp:35:rm.0 00000100:00100000:1.0:1787380360.968613:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e19c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:9663:x1874203915602944:12345-192.168.206.14@tcp:35:rm.0 Request processed in 312us (478us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787380360.968621:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:2.0:1787380360.971406:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380360.971486:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915603200 00000100:00100000:1.0:1787380360.971494:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915603200 00000100:00100000:1.0:1787380360.971537:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:1.0:1787380360.971544:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:9663:x1874203915603200:12345-192.168.206.14@tcp:101:rm.0 00010000:00010000:1.0:1787380360.971576:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380360.971594:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d1188425e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f672d expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.971693:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d1188425ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.971706:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d1188425ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.971716:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d1188425ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380360.971726:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787380360.971824:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d1188425e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f672d expref: 17 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.971840:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d1188425ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f672d expref: 16 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.971848:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:1.0:1787380360.971851:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380360.971854:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96813f3400, rc 0) 00000100:00100000:1.0:1787380360.971903:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:9663:x1874203915603200:12345-192.168.206.14@tcp:101:rm.0 Request processed in 359us (505us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787380360.971909:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:2.0:1787380360.980469:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380360.981733:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915603328 00000100:00100000:3.0:1787380360.981746:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915603328 00000100:00100000:3.0:1787380360.981827:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1787380360.981838:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:9663:x1874203915603328:12345-192.168.206.14@tcp:41:rm.0 00000004:00000024:3.0:1787380360.981894:0:5786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787380360.981972:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:9663:x1874203915603328:12345-192.168.206.14@tcp:41:rm.0 Request processed in 133us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.981980:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1787380360.985211:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380360.985310:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915603456 00000100:00100000:1.0:1787380360.985320:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915603456 00000100:00100000:1.0:1787380360.985416:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:1.0:1787380360.985437:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:9663:x1874203915603456:12345-192.168.206.14@tcp:101:rm.0 00010000:00010000:1.0:1787380360.985455:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380360.985480:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d1188425fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6734 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985533:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985546:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985556:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985569:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985575:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985591:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985701:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985711:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985720:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380360.985756:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787380360.985760:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380360.985777:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985788:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985796:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985802:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985809:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985814:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f3600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380360.985830:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985837:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985848:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:1.0:1787380360.985851:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380360.985856:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985862:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3600/0x651a07d118842604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985884:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985890:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985895:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985899:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f2000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380360.985902:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985908:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985915:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7740a54f (ffff9d968911da00) 00010000:00010000:1.0:1787380360.985917:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380360.985920:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985925:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2000/0x651a07d11884260b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985952:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f2600/0x651a07d1188425fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6734 expref: 18 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985963:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6734 expref: 17 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.985979:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d96991e8f00) 00010000:00010000:1.0:1787380360.985981:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380360.985983:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f000, rc 0) 00000100:00100000:1.0:1787380360.986045:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:9663:x1874203915603456:12345-192.168.206.14@tcp:101:rm.0 Request processed in 608us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380360.986052:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:2.0:1787380360.998781:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380360.998878:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915603712 00000100:00100000:1.0:1787380360.998886:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915603712 00000100:00100000:1.0:1787380360.998951:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:1.0:1787380360.998960:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:9663:x1874203915603712:12345-192.168.206.14@tcp:36:rm.0 00010000:00010000:1.0:1787380360.999012:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787380360.999037:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6734 expref: 17 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999058:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188425be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6718 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999069:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d96991e8f00) 00010000:00010000:1.0:1787380360.999085:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188425d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f671f expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999094:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:1.0:1787380360.999097:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380360.999115:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999144:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999154:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999168:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999175:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999181:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999332:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999712:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380360.999720:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380361.000449:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787380361.000461:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311312122064ns, next at 312312119869ns, rc = 0 00010000:00010000:1.0:1787380361.000519:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000529:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000547:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000554:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000560:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000565:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000883:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380361.000904:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000911:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000917:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000923:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380361.000927:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000934:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000946:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d968911d900) 00010000:00010000:1.0:1787380361.000948:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787380361.000959:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000966:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f600/0x651a07d118842627 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000983:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000989:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000995:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.000999:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380361.001002:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.001008:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.001015:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:1.0:1787380361.001017:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380361.001020:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.001026:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842619 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380361.001035:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000241e56e1 reply state 0000000065526762 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380361.001055:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380361.001181:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:9663:x1874203915603712:12345-192.168.206.14@tcp:36:rm.0 Request processed in 2217us (2404us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787380361.001190:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00010000:00010000:3.0:1787380361.002451:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380361.002461:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.002469:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380361.002473:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.002480:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.002493:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d968911d900) 00010000:00010000:3.0:1787380361.002508:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787380361.002512:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.002518:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d11884262e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.002539:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380361.002541:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380361.002543:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380361.008906:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.008922:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.008929:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.008934:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380361.008938:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.008945:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.008960:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7740a54f (ffff9d968911da00) 00010000:00010000:3.0:1787380361.008963:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380361.008967:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.008974:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842620 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7740a54f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380361.009757:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380361.009822:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915603968 00000100:00100000:1.0:1787380361.009831:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915603968 00000100:00100000:1.0:1787380361.009884:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:1.0:1787380361.009893:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:9663:x1874203915603968:12345-192.168.206.14@tcp:35:rm.0 00000100:00100000:1.0:1787380361.010153:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:9663:x1874203915603968:12345-192.168.206.14@tcp:35:rm.0 Request processed in 258us (400us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787380361.010161:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:2.0:1787380361.013905:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380361.013988:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915604224 00000100:00100000:0.0:1787380361.013997:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915604224 00000100:00100000:0.0:1787380361.014059:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:0.0:1787380361.014083:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:9663:x1874203915604224:12345-192.168.206.14@tcp:36:rm.0 00010000:00010000:0.0:1787380361.014138:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787380361.014162:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3400/0x651a07d1188425ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f672d expref: 16 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014184:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96813f3c00/0x651a07d11884258d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f670a expref: 15 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014194:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d968911de00) 00010000:00010000:0.0:1787380361.014209:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d11884254e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66fc expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014218:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727ff00) 00010000:00010000:0.0:1787380361.014225:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380361.014247:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014258:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014268:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014280:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014286:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014293:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014626:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014635:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.014642:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380361.015203:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787380361.015220:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015227:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015234:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015240:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380361.015244:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015252:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015262:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d96991e8800) 00010000:00010000:0.0:1787380361.015265:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787380361.015269:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015286:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842643 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015305:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015312:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015317:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015322:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380361.015326:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015332:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015389:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96991e8100) 00010000:00010000:0.0:1787380361.015392:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380361.015395:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.015400:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842635 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380361.015412:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c5f64531 reply state 00000000ef0adde5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380361.015420:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380361.015500:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:9663:x1874203915604224:12345-192.168.206.14@tcp:36:rm.0 Request processed in 1417us (1602us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787380361.015507:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 31 00010000:00010000:0.0:1787380361.017149:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.017163:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.017170:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.017176:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380361.017180:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.017188:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.017203:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d96991e8c00) 00010000:00010000:0.0:1787380361.017206:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380361.017209:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.017216:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884263c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380361.463913:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380361.463935:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380361.464014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.464368:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560832 00000100:00100000:0.0:1787380361.464386:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560832 00000100:00100000:0.0:1787380361.464457:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787380361.464467:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935560832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380361.464503:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380361.464569:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935560832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.464576:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787380361.464683:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787380361.465238:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bd43df80 x1874203935560832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380361.465259:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935560832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380361.584925:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380361.585069:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915604352 00000100:00100000:3.0:1787380361.585079:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915604352 00000100:00100000:3.0:1787380361.585137:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 247 00000100:00100000:3.0:1787380361.585147:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915604352:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380361.586767:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915604352:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 1613us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380361.586779:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 247 00000100:00100000:2.0:1787380361.587796:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380361.587952:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380361.587988:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380361.588058:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915604480 00000100:00100000:1.0:1787380361.588067:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915604480 00000100:00100000:1.0:1787380361.588114:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915604736 00000100:00100000:1.0:1787380361.588118:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915604736 00000100:00100000:1.0:1787380361.588149:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 99 00000100:00100000:1.0:1787380361.588159:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:2353:x1874203915604480:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380361.588723:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915604608 00000100:00100000:3.0:1787380361.588729:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915604608 00000100:00100000:3.0:1787380361.588764:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:3.0:1787380361.588773:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915604608:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380361.592205:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:2353:x1874203915604480:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 4034us (4249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380361.592239:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 99 00000100:00100000:1.0:1787380361.592287:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 100 00000100:00100000:1.0:1787380361.592300:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915604736:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380361.593422:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915604608:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 4643us (5623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380361.593436:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00080000:3.0:1787380361.593506:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380361.595481:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915604736:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 3175us (7481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380361.595498:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 100 00010000:00010000:3.0:1787380361.719623:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380362.746418:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380363.767646:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380364.791856:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380365.055781:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935560960:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.055867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.055938:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935561472:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.055968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.056105:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787380365.056112:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935561088:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.056134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.056151:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935561600:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.056173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.056208:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935561216:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.056230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.056247:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380365.056252:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935561344:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.056271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.056299:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561472 00000100:00100000:0.0:1787380365.056306:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561472 00000100:00100000:0.0:1787380365.056393:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561088 00000100:00100000:0.0:1787380365.056396:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561088 00000100:00100000:0.0:1787380365.056410:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561216 00000100:00100000:3.0:1787380365.056509:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935560960 00000100:00100000:3.0:1787380365.056513:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935560960 00000100:00100000:3.0:1787380365.056544:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787380365.056552:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935560960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380365.056602:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935560960:12345-0@lo:400:kworker.0 Request processed in 50us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380365.056608:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787380365.057016:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561216 00000100:00100000:0.0:1787380365.057044:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787380365.057051:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935561472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.057096:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935561472:12345-0@lo:400:kworker.0 Request processed in 45us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.057102:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787380365.057115:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787380365.057121:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935561088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.057147:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935561088:12345-0@lo:400:kworker.0 Request processed in 27us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.057152:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787380365.057162:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787380365.057168:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935561216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.057209:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935561216:12345-0@lo:400:kworker.0 Request processed in 42us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.057215:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787380365.057236:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561600 00000100:00100000:0.0:1787380365.057241:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561600 00000100:00100000:0.0:1787380365.057262:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561344 00000100:00100000:0.0:1787380365.057265:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561344 00000100:00100000:0.0:1787380365.057282:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787380365.057288:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935561600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.057317:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935561600:12345-0@lo:400:kworker.0 Request processed in 29us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.057322:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787380365.057332:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787380365.057367:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935561344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.057395:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935561344:12345-0@lo:400:kworker.0 Request processed in 58us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.057410:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787380365.057655:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5234000 x1874203935561344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380365.057669:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935561344:0@lo:400:kworker.0 00000100:00100000:3.0:1787380365.057681:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935561216:0@lo:400:kworker.0 00000100:00080000:0.0:1787380365.061116:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380365.061125:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380365.061128:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380365.061199:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935561088:0@lo:400:kworker.0 00010000:00080000:0.0:1787380365.061217:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5236d80 x1874203935561600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380365.061226:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5236d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935561600:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.061235:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935560960:0@lo:400:kworker.0 00000100:00100000:0.0:1787380365.061246:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935561472:0@lo:400:kworker.0 00000001:02000400:2.0:1787380365.483929:0:11457:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1787380365.566566:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcaf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935561728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380365.566628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380365.566740:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561728 00000100:00100000:1.0:1787380365.566748:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561728 00000100:00100000:1.0:1787380365.566797:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787380365.566807:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935561728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380365.566842:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380365.566886:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935561728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380365.566894:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787380365.566989:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96bcaf2a00 x1874203935561728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380365.567006:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcaf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935561728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787380365.817695:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787380366.160328:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787380366.160377:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787380366.160523:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935561856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787380366.160692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380366.160761:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561856 00000100:00100000:3.0:1787380366.160767:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561856 00000100:00100000:3.0:1787380366.160886:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380366.160896:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935561856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787380366.160920:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1787380366.161024:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a894288, atime: 0x6a894288, ctime: 0x6a894288, blocks: 0x1 00010000:00010000:3.0:1787380366.161032:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.161047:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=316s v=(0 0) 00010000:00010000:3.0:1787380366.161051:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380366.161057:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.161073:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.161084:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.161104:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.161122:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787380366.163230:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1874203935561856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2331us (2533us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787380366.163242:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787380366.163271:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380366.163278:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.163289:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163ba00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380366.163294:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.163304:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.163323:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.163330:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac12c8af/0x651a07d11884264a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.163380:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380366.163389:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380366.163391:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787380366.163713:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d95865a2300/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787380366.163721:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935561856:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787380366.583898:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935561984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380366.583987:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380366.584368:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935561984 00000100:00100000:1.0:1787380366.584377:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935561984 00000100:00100000:1.0:1787380366.584428:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787380366.584438:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935561984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380366.584472:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380366.584526:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935561984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.584534:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380366.584753:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935561984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380366.714302:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380366.714382:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380366.714415:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380366.714440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380366.714579:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915605120 00000100:00100000:2.0:1787380366.714589:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915605120 00000100:00100000:2.0:1787380366.714658:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:2.0:1787380366.714668:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915605120:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380366.714739:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915605120:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 73us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380366.714747:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00080000:1.0:1787380366.715125:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380366.715188:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915604864 00000100:00100000:0.0:1787380366.715193:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915604864 00000100:00100000:0.0:1787380366.715227:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 249 00000100:00100000:0.0:1787380366.715234:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2355:x1874203915604864:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380366.715378:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915604992 00000100:00100000:1.0:1787380366.715382:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915604992 00000100:00100000:1.0:1787380366.715419:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915605248 00000100:00100000:1.0:1787380366.715422:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915605248 00000100:00100000:1.0:1787380366.715444:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:1.0:1787380366.715451:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915604992:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380366.715490:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915604992:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 40us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.715497:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:1.0:1787380366.715511:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 105 00000100:00100000:1.0:1787380366.715518:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2355:x1874203915605248:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380366.715540:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2355:x1874203915605248:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 23us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.715547:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 105 00000100:00080000:2.0:1787380366.715727:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380366.715992:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2355:x1874203915604864:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 756us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.716000:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 249 00010000:00010000:2.0:1787380366.841222:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787380366.872539:0:11508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc1e1aa4b0 00000020:00000080:1.0:1787380366.874825:0:11508:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787380366.874834:0:11508:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787380366.874854:0:11508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1e1ac740 20000000:00000080:1.0:1787380366.874862:0:11508:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d96bd250800 uarg=0000000000000000 20000000:01000000:1.0:1787380366.874902:0:11508:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787380366.874908:0:11508:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787380366.874913:0:11508:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787380366.877271:0:11509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787380366.877679:0:11508:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787380366.889121:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787380366.889180:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787380366.889238:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787380366.889256:0:11508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787380366.889275:0:11508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889295:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889304:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889312:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188424fa expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889318:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842508 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889325:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842516 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889332:0:11508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889421:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842516 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889435:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842516 expref: 18 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.889450:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562112:0@lo:104: 00000100:00100000:0.0:1787380366.889519:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380366.889678:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118842508 expref: 18 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889687:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118842508 expref: 18 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.889695:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562240:0@lo:104: 00000100:00100000:0.0:1787380366.889720:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380366.889801:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188424fa expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.889809:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188424fa expref: 18 pid: 5781 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.889817:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562368:0@lo:104: 00000100:00100000:0.0:1787380366.889844:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380366.891049:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935562112 00000100:00100000:3.0:1787380366.891058:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935562112 00000100:00100000:3.0:1787380366.891097:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935562240 00000100:00100000:3.0:1787380366.891100:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935562240 00000100:00100000:3.0:1787380366.891109:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935562368 00000100:00100000:3.0:1787380366.891111:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935562368 00000100:00100000:3.0:1787380366.891124:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380366.891133:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:11508:x1874203935562112:12345-0@lo:104: 00010000:00010000:3.0:1787380366.891146:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.891207:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380366.891213:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+5:11508:x1874203935562112:12345-0@lo:104: Request processed in 82us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380366.891220:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380366.891236:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380366.891242:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:11508:x1874203935562240:12345-0@lo:104: 00010000:00010000:3.0:1787380366.891249:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.891288:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380366.891293:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+4:11508:x1874203935562240:12345-0@lo:104: Request processed in 52us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380366.891298:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380366.891310:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380366.891315:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b51fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:11508:x1874203935562368:12345-0@lo:104: 00010000:00010000:3.0:1787380366.891333:0:5770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.891393:0:5770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787380366.891398:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b51fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aaaa441-7de5-4747-b366-e84ba9a288bb+3:11508:x1874203935562368:12345-0@lo:104: Request processed in 84us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380366.891405:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380366.891460:0:8291:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:3.0:1787380366.891504:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.891516:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 12 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380366.891528:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562496:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380366.891649:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787380366.891656:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891664:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380366.891668:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891677:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380366.891684:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380366.891701:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787380366.891732:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891738:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380366.891757:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891764:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968af54800/0x651a07d118842516 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884251d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891776:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380366.891780:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891786:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380366.891789:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891795:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380366.891801:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380366.891806:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787380366.891819:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891825:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380366.891848:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891855:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968af55400/0x651a07d118842508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884250f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891864:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380366.891868:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891873:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380366.891876:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891882:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380366.891888:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380366.891893:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787380366.891905:0:5774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891911:0:5774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380366.891917:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891923:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968af54e00/0x651a07d1188424fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118842501 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.891935:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380366.891943:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380366.891945:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380366.891967:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935562624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380366.892035:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.892044:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380366.892053:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935563008:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380366.892261:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380366.892644:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935562752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380366.892848:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380366.892898:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935562880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380366.892921:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380366.892949:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935562624 00000100:00100000:0.0:1787380366.892955:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935562624 00010000:00010000:0.0:1787380366.892981:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842516 expref: 19 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.893004:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935562880 00000100:00100000:0.0:1787380366.893006:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935562880 00010000:00010000:0.0:1787380366.893017:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188424fa expref: 20 pid: 5781 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.893034:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380366.893041:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+20:3302:x1874203935562624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380366.893051:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380366.893056:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842516 expref: 20 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.893067:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842516 expref: 20 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.893083:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380366.893112:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+20:3302:x1874203935562624:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.893118:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380366.893143:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787380366.893148:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935562880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380366.893155:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380366.893159:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188424fa expref: 19 pid: 5781 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.893166:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188424fa expref: 19 pid: 5781 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.893175:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380366.893198:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935562880:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.893204:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787380366.893240:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935562880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380366.893263:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935562624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380366.893903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380366.895487:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935562752 00000100:00100000:2.0:1787380366.895498:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935562752 00010000:00010000:2.0:1787380366.895534:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842508 expref: 19 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380366.895673:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380366.895682:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935562752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380366.895695:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380366.895700:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118842508 expref: 19 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380366.895711:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118842508 expref: 19 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380366.895729:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380366.895798:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c50450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935562752:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380366.895805:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787380366.895934:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935562752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380366.896444:0:11508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698854840 going to sleep for 11 seconds 00010000:00010000:0.0:1787380366.896461:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1fa00/0x651a07d11884251d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842516 expref: 18 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.896474:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562112:0@lo:104: 00010000:00010000:0.0:1787380366.896483:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1f800/0x651a07d11884250f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118842508 expref: 17 pid: 5779 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.896491:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562240:0@lo:104: 00010000:00010000:0.0:1787380366.896499:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af55600/0x651a07d118842501 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188424fa expref: 16 pid: 5781 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.896507:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562368:0@lo:104: 00000100:00100000:1.0:1787380366.898895:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380366.898940:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915605376 00000100:00100000:1.0:1787380366.898948:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915605376 00010000:00010000:1.0:1787380366.898984:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 13 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380366.899018:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:1.0:1787380366.899027:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915605376:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380366.899040:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380366.899045:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 13 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.899057:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 13 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.899074:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380366.899120:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915605376:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.899128:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 33 00010000:00010000:3.0:1787380366.903194:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1e400/0x651a07d1188424f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66ee expref: 12 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380366.903217:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935562496:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380366.903845:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380366.903946:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915605504 00000100:00100000:0.0:1787380366.903954:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915605504 00010000:00010000:0.0:1787380366.903987:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380366.904021:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:0.0:1787380366.904029:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:2356:x1874203915605504:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380366.904042:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380366.904048:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904059:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 12 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904078:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904086:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904101:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904107:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904114:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904119:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904141:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380366.904146:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904153:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904162:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.904172:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380366.904225:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:2356:x1874203915605504:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 196us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.904233:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 34 00010000:00010000:3.0:1787380366.905788:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2800/0x651a07d1188424ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66e7 expref: 11 pid: 5781 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380366.905821:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5123480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874203935563008:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380366.905854:0:11508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.905864:0:11508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.905871:0:11508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.905877:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1e800/0x651a07d118842651 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380367.868064:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380368.241479:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380368.241745:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915605632 00000100:00100000:0.0:1787380368.241755:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915605632 00000100:00100000:0.0:1787380368.241808:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 250 00000100:00100000:0.0:1787380368.241818:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:5570:x1874203915605632:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380368.241834:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380368.241853:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1fa00/0x651a07d118842658 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f673b expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.241881:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1fa00/0x651a07d118842658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f673b expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.241892:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1fa00/0x651a07d118842658 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f673b expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.241922:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1fa00, rc 0) 00000100:00100000:0.0:1787380368.241985:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687194850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915605632:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 168us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.241993:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 250 00000100:00100000:1.0:1787380368.243594:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380368.243883:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915605760 00000100:00100000:0.0:1787380368.243891:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915605760 00000100:00100000:0.0:1787380368.243942:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 251 00000100:00100000:0.0:1787380368.243952:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915605760:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.244222:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915605760:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 270us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.244231:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 251 00000100:00100000:1.0:1787380368.255273:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380368.255386:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915605888 00000100:00100000:2.0:1787380368.255396:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915605888 00000100:00100000:2.0:1787380368.255453:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 252 00000100:00100000:2.0:1787380368.255463:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915605888:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380368.255666:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915605888:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 204us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380368.255682:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 252 00000100:00100000:1.0:1787380368.266693:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380368.266860:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606016 00000100:00100000:2.0:1787380368.266869:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606016 00000100:00100000:2.0:1787380368.266924:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 253 00000100:00100000:2.0:1787380368.266934:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:9933:x1874203915606016:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380368.267165:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:9933:x1874203915606016:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 232us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380368.267174:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 253 00000100:00100000:1.0:1787380368.276578:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380368.277050:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606144 00000100:00100000:0.0:1787380368.277060:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606144 00000100:00100000:0.0:1787380368.277119:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 254 00000100:00100000:0.0:1787380368.277129:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:9933:x1874203915606144:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380368.277419:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:9933:x1874203915606144:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 290us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.277429:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 254 00000100:00100000:1.0:1787380368.281155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380368.281249:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606272 00000100:00100000:3.0:1787380368.281258:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606272 00000100:00100000:3.0:1787380368.281322:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 255 00000100:00100000:3.0:1787380368.281332:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:5570:x1874203915606272:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380368.281388:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380368.281406:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163ba00/0x651a07d11884265f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6742 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.281430:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163ba00/0x651a07d11884265f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6742 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.281442:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163ba00/0x651a07d11884265f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6742 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.281451:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163ba00, rc 0) 00000100:00100000:3.0:1787380368.281521:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915606272:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 190us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380368.281528:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 255 00000100:00100000:1.0:1787380368.284139:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380368.284228:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606400 00000100:00100000:2.0:1787380368.284237:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606400 00000100:00100000:2.0:1787380368.284297:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 256 00000100:00100000:2.0:1787380368.284307:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915606400:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380368.288190:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915606400:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 3874us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380368.288204:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 256 00000100:00100000:1.0:1787380368.299261:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380368.299427:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606528 00000100:00100000:0.0:1787380368.299438:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606528 00000100:00100000:0.0:1787380368.299492:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 257 00000100:00100000:0.0:1787380368.299510:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915606528:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.299722:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:5570:x1874203915606528:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 221us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.299740:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 257 00000100:00100000:3.0:1787380368.310459:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380368.310564:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606656 00000100:00100000:2.0:1787380368.310573:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606656 00000100:00100000:2.0:1787380368.310629:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 258 00000100:00100000:2.0:1787380368.310639:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:9936:x1874203915606656:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380368.310882:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:9936:x1874203915606656:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 243us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380368.310890:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 258 00000100:00100000:1.0:1787380368.319462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380368.319969:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606784 00000100:00100000:3.0:1787380368.319979:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606784 00000100:00100000:3.0:1787380368.320033:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 259 00000100:00100000:3.0:1787380368.320043:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:9936:x1874203915606784:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380368.321284:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:9936:x1874203915606784:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 1236us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380368.321295:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 259 10000000:01000000:0.0:1787380368.439465:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380368.439474:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d969f0ea800 from 7 10000000:01000000:0.0:1787380368.439479:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380368.439527:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.439539:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.439561:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380368.439589:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.439659:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380368.439731:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698854a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380368.440141:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935563136 00000100:00100000:3.0:1787380368.440149:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935563136 00000100:00100000:3.0:1787380368.440202:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787380368.440211:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:5783:x1874203935563136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380368.440225:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380368.440251:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b400/0x651a07d11884266d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842666 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.440283:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b400/0x651a07d11884266d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842666 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.440294:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b400/0x651a07d11884266d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842666 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.440304:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b400, rc 0) 00000100:00100000:3.0:1787380368.440632:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935563136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380368.440656:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787380368.440753:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380368.440768:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.440846:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380368.440904:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.440935:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380368.440965:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698854a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380368.441016:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935563264 00000100:00100000:3.0:1787380368.441021:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935563264 00000100:00100000:3.0:1787380368.441051:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787380368.441057:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935563264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380368.441293:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935563264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380368.441301:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787380368.441430:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.441466:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.441503:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380368.441528:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698854a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380368.441690:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935563392 00000100:00100000:2.0:1787380368.441695:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935563392 00000100:00100000:2.0:1787380368.441730:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787380368.441737:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935563392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380368.441894:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935563392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380368.441902:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787380368.442045:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.442700:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11521:1874203935563520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380368.442741:0:11521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380368.442772:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698854a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380368.443397:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935563520 00000100:00100000:2.0:1787380368.443403:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935563520 00000100:00100000:2.0:1787380368.443448:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787380368.443457:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:11521:x1874203935563520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380368.444697:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:11521:x1874203935563520:12345-0@lo:502:llog_process_th.0 Request processed in 1235us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380368.444709:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787380368.444897:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11521:1874203935563520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787380368.444929:0:11521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380368.444937:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380368.444939:0:11521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787380368.444946:0:11521:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d969f0ea800 00000020:00000080:0.0:1787380368.444949:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787380368.445039:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11521:1874203935563648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380368.445086:0:11521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380368.445124:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698854a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380368.445815:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935563648 00000100:00100000:3.0:1787380368.445824:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935563648 00000100:00100000:3.0:1787380368.445875:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787380368.445884:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:11521:x1874203935563648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380368.446109:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:11521:x1874203935563648:12345-0@lo:502:llog_process_th.0 Request processed in 226us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380368.446117:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787380368.446290:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11521:1874203935563648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380368.446313:0:11521:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380368.446319:0:11521:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380368.446321:0:11521:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787380368.446326:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787380368.450506:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787380368.450555:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380368.450570:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.450583:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380368.450592:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380368.450595:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96ba3b2800 from 7 10000000:01000000:3.0:1787380368.450597:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380368.450629:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.450643:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.450654:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380368.450678:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380368.450736:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380368.450766:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380368.451172:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935563776 00000100:00100000:0.0:1787380368.451180:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935563776 00000100:00100000:0.0:1787380368.451225:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787380368.451233:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:5783:x1874203935563776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380368.451245:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380368.451257:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1e800/0x651a07d11884267b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842674 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.451278:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1e800/0x651a07d11884267b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842674 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.451288:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1e800/0x651a07d11884267b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842674 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.451304:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e800, rc 0) 00000100:00100000:0.0:1787380368.451372:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935563776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.451378:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787380368.451462:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5123480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380368.451476:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.451484:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380368.451531:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380368.451566:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380368.451587:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380368.452318:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935563904 00000100:00100000:0.0:1787380368.452325:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935563904 00000100:00100000:0.0:1787380368.452378:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787380368.452385:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935563904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.452629:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935563904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.452636:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787380368.452668:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935563904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.452698:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.452731:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380368.452744:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba36e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787380368.452753:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564032 00000100:00100000:0.0:1787380368.452756:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564032 00000100:00100000:0.0:1787380368.452768:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787380368.452772:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935564032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.453010:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935564032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.453016:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787380368.453047:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380368.459530:0:11524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11524:1874203935564160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380368.459760:0:11524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380368.459931:0:11524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380368.465451:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564160 00000100:00100000:0.0:1787380368.465476:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564160 00000100:00100000:0.0:1787380368.465525:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787380368.465534:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:11524:x1874203935564160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380368.465976:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:11524:x1874203935564160:12345-0@lo:502:llog_process_th.0 Request processed in 441us (6213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.465985:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787380368.466047:0:11524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11524:1874203935564160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787380368.466089:0:11524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380368.466098:0:11524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380368.466101:0:11524:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787380368.466108:0:11524:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d96ba3b2800 00000020:00000080:0.0:1787380368.466110:0:11524:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787380368.466191:0:11524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11524:1874203935564288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380368.466234:0:11524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380368.467165:0:11524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ba13c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380368.467276:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564288 00000100:00100000:3.0:1787380368.467283:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564288 00000100:00100000:3.0:1787380368.467329:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787380368.467370:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:11524:x1874203935564288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380368.467686:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:11524:x1874203935564288:12345-0@lo:502:llog_process_th.0 Request processed in 348us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380368.467694:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787380368.467787:0:11524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11524:1874203935564288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380368.467814:0:11524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380368.467821:0:11524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380368.467823:0:11524:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787380368.467827:0:11524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787380368.468043:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787380368.468064:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380368.468073:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.468084:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380368.468094:0:5783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380368.468096:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d968b549800 from 7 10000000:01000000:3.0:1787380368.468099:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380368.468129:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.468138:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.468148:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380368.468165:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380368.468197:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380368.468227:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380368.468273:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564416 00000100:00100000:1.0:1787380368.468278:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564416 00000100:00100000:1.0:1787380368.468309:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787380368.468323:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:5783:x1874203935564416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380368.468332:0:5779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380368.468370:0:5779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515f600/0x651a07d118842689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118842682 expref: -99 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.468391:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515f600/0x651a07d118842689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118842682 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.468401:0:5779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515f600/0x651a07d118842689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118842682 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.468410:0:5779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f600, rc 0) 00000100:00100000:1.0:1787380368.468441:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935564416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380368.468448:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787380368.468570:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380368.468582:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.468591:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380368.468632:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380368.468657:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380368.468681:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380368.468795:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564544 00000100:00100000:1.0:1787380368.468799:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564544 00000100:00100000:1.0:1787380368.468828:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787380368.468834:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935564544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380368.469043:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935564544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380368.469050:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787380368.469203:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380368.469227:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380368.469262:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380368.469282:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380368.469327:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564672 00000100:00100000:0.0:1787380368.469331:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564672 00000100:00100000:0.0:1787380368.469386:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787380368.469392:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935564672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380368.469526:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:5783:x1874203935564672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.469532:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787380368.469672:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aaaa441-7de5-4747-b366-e84ba9a288bb:5783:1874203935564672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380368.471653:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11525:1874203935564800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380368.471729:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380368.471768:0:11525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380368.471948:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564800 00000100:00100000:0.0:1787380368.471953:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564800 00000100:00100000:0.0:1787380368.471996:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787380368.472004:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:11525:x1874203935564800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380368.472196:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:11525:x1874203935564800:12345-0@lo:502:llog_process_th.0 Request processed in 192us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380368.472210:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787380368.473785:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11525:1874203935564800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380368.473822:0:11525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380368.473833:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380368.473835:0:11525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787380368.473844:0:11525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d968b549800 00000020:00000080:1.0:1787380368.473846:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380368.473929:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11525:1874203935564928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380368.473983:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380368.474016:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935564928 00000100:00100000:1.0:1787380368.474021:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935564928 00000100:00100000:1.0:1787380368.474056:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787380368.474065:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:11525:x1874203935564928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380368.474234:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:11525:x1874203935564928:12345-0@lo:502:llog_process_th.0 Request processed in 170us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380368.474256:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787380368.474307:0:11525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380368.474320:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aaaa441-7de5-4747-b366-e84ba9a288bb:11525:1874203935564928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380368.474366:0:11525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380368.474371:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380368.474373:0:11525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787380368.474376:0:11525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787380368.475288:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787380368.475311:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380368.475321:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380368.475333:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380368.487601:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380368.888212:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787380369.528265:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787380369.911904:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380370.167982:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935565312:0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.168051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380370.168064:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935565184:0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380370.168125:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380370.168130:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935565696:0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.168135:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935565440:0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168160:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380370.168180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380370.168192:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787380370.168201:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935565056:0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.168217:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565696 00000100:00100000:3.0:1787380370.168224:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565696 00000100:00100000:1.0:1787380370.168234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380370.168262:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935565568:0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.168278:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565440 00000100:00100000:3.0:1787380370.168283:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565440 00000100:00100000:1.0:1787380370.168287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380370.168312:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787380370.168322:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935565696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168323:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565312 00000100:00100000:1.0:1787380370.168367:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565312 00000100:00100000:1.0:1787380370.168415:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565184 00000100:00100000:1.0:1787380370.168419:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565184 00000100:00100000:3.0:1787380370.168425:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935565696:12345-0@lo:400:kworker.0 Request processed in 104us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380370.168434:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787380370.168435:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565568 00000100:00100000:1.0:1787380370.168439:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565568 00000100:00100000:3.0:1787380370.168456:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787380370.168462:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787380370.168467:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935565440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168474:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935565312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.168506:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935565440:12345-0@lo:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380370.168514:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787380370.168521:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935565312:12345-0@lo:400:kworker.0 Request processed in 50us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380370.168530:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787380370.168531:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380370.168536:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380370.168538:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380370.168562:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787380370.168571:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935565184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.168577:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5158a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935565440:0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168604:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935565184:12345-0@lo:400:kworker.0 Request processed in 34us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380370.168605:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935565312:0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168619:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787380370.168636:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787380370.168644:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935565568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.168651:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935565184:0@lo:400:kworker.0 00010000:00080000:3.0:1787380370.168666:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b515bb80 x1874203935565696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380370.168677:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935565568:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380370.168680:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935565696:0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168688:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787380370.168707:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935565568:0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168718:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565056 00000100:00100000:1.0:1787380370.168723:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565056 00000100:00100000:1.0:1787380370.168750:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787380370.168757:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935565056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380370.168796:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935565056:12345-0@lo:400:kworker.0 Request processed in 40us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380370.168802:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787380370.168979:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935565056:0@lo:400:kworker.0 00000100:00100000:3.0:1787380370.679629:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935565824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380370.679696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380370.679886:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565824 00000100:00100000:1.0:1787380370.679906:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565824 00000100:00100000:1.0:1787380370.679961:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787380370.679971:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935565824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380370.680004:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380370.680054:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935565824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380370.680060:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787380370.681315:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5f36a00 x1874203935565824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380370.681367:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935565824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380370.936648:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787380371.265015:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1787380371.703618:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935565952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380371.703690:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380371.705761:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935565952 00000100:00100000:1.0:1787380371.705775:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935565952 00000100:00100000:1.0:1787380371.705840:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787380371.705850:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935565952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380371.705899:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380371.705981:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935565952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380371.705988:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787380371.706168:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787380371.706174:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d95865a2300, transno 4294967300 00000100:00100000:2.0:1787380371.706203:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935565952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380371.830439:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380371.830500:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380371.830560:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380371.830585:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380371.830613:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607168 00000100:00100000:1.0:1787380371.830621:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607168 00000100:00100000:1.0:1787380371.830678:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:1.0:1787380371.830687:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915607168:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380371.830748:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915607168:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380371.830755:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00080000:1.0:1787380371.830773:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380371.830950:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607040 00000100:00100000:2.0:1787380371.830955:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607040 00000100:00100000:2.0:1787380371.830998:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607296 00000100:00100000:2.0:1787380371.831001:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607296 00000100:00100000:2.0:1787380371.831023:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 109 00000100:00100000:2.0:1787380371.831029:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915607040:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380371.831065:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915607040:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 36us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380371.831071:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 109 00000100:00100000:2.0:1787380371.831083:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 110 00000100:00100000:2.0:1787380371.831089:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915607296:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380371.831113:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915607296:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 23us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380371.831119:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 110 00000100:00100000:0.0:1787380371.831412:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915606912 00000100:00100000:0.0:1787380371.831418:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915606912 00000100:00100000:0.0:1787380371.831454:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 276 00000100:00100000:0.0:1787380371.831461:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915606912:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380371.831490:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915606912:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380371.831496:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 276 00000100:00080000:1.0:1787380371.831687:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787380371.959839:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380372.984744:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380374.007767:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380375.031935:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380375.289827:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935566080:0@lo:400:kworker.0 00000100:00100000:0.0:1787380375.289911:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380375.292103:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566080 00000100:00100000:2.0:1787380375.292115:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566080 00000100:00100000:2.0:1787380375.292178:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787380375.292188:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935566080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380375.293992:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935566208:0@lo:400:kworker.0 00000100:00100000:3.0:1787380375.294053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380375.294106:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566208 00000100:00100000:3.0:1787380375.294113:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566208 00000100:00100000:3.0:1787380375.294157:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787380375.294167:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935566208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380375.294213:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935566208:12345-0@lo:400:kworker.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380375.294220:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787380375.294265:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935566208:0@lo:400:kworker.0 00000100:00100000:2.0:1787380375.295247:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935566080:12345-0@lo:400:kworker.0 Request processed in 3056us (5331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380375.295259:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787380375.295473:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935566336:0@lo:400:kworker.0 00000100:00100000:3.0:1787380375.295525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380375.295619:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566336 00000100:00100000:2.0:1787380375.295626:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566336 00000100:00100000:2.0:1787380375.295676:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787380375.295685:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935566336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380375.297224:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935566080:0@lo:400:kworker.0 00000100:00080000:0.0:1787380375.297284:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380375.297323:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935566464:0@lo:400:kworker.0 00000100:00100000:0.0:1787380375.297386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380375.297437:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566464 00000100:00100000:0.0:1787380375.297453:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566464 00000100:00100000:0.0:1787380375.297496:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787380375.297517:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935566464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380375.297564:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935566464:12345-0@lo:400:kworker.0 Request processed in 61us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380375.297957:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787380375.297993:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380375.298016:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935566464:0@lo:400:kworker.0 00000100:00100000:2.0:1787380375.298380:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935566336:12345-0@lo:400:kworker.0 Request processed in 2695us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380375.298389:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787380375.298526:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935566336:0@lo:400:kworker.0 00000100:00100000:1.0:1787380375.298891:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935566720:0@lo:400:kworker.0 00000100:00100000:1.0:1787380375.298931:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380375.298955:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380375.298961:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935566592:0@lo:400:kworker.0 00000100:00100000:1.0:1787380375.298997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380375.299025:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566720 00000100:00100000:1.0:1787380375.299030:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566720 00000100:00100000:1.0:1787380375.299069:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787380375.299077:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935566720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380375.299120:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935566720:12345-0@lo:400:kworker.0 Request processed in 43us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380375.299127:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787380375.299145:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380375.299154:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566592 00000100:00100000:1.0:1787380375.299157:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566592 00000100:00100000:1.0:1787380375.299187:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787380375.299193:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935566592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380375.299221:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935566592:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380375.299227:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1787380375.299241:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380375.299259:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935566592:0@lo:400:kworker.0 00010000:00080000:1.0:1787380375.299270:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96911bdf80 x1874203935566720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380375.299279:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935566720:0@lo:400:kworker.0 00000100:00100000:3.0:1787380375.800887:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935566848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380375.800956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380375.801267:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566848 00000100:00100000:1.0:1787380375.801275:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566848 00000100:00100000:1.0:1787380375.801330:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787380375.801358:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935566848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380375.801390:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380375.801437:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935566848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380375.801444:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787380375.801608:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96911bdf80 x1874203935566848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380375.801625:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935566848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787380376.055718:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380376.825203:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380376.825227:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935566976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380376.825309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380376.825459:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935566976 00000100:00100000:1.0:1787380376.825467:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935566976 00000100:00100000:1.0:1787380376.825520:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380376.825530:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935566976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380376.825565:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380376.825613:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5236d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935566976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380376.825620:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787380376.829143:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935566976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380376.945236:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380376.945278:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380376.945328:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380376.945395:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380376.945481:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607552 00000100:00100000:2.0:1787380376.945491:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607552 00000100:00100000:2.0:1787380376.945575:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607808 00000100:00100000:2.0:1787380376.945578:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607808 00000100:00100000:2.0:1787380376.945603:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 114 00000100:00100000:2.0:1787380376.945611:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915607552:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380376.945678:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915607552:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 67us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380376.945686:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 114 00000100:00100000:2.0:1787380376.945719:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 115 00000100:00100000:2.0:1787380376.945726:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915607808:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380376.945751:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915607808:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 25us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380376.945757:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 115 00000100:00100000:0.0:1787380376.946117:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607680 00000100:00100000:0.0:1787380376.946123:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607680 00000100:00100000:0.0:1787380376.946163:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:0.0:1787380376.946170:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915607680:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380376.946208:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915607680:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 39us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380376.946215:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:3.0:1787380376.946316:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607424 00000100:00100000:3.0:1787380376.946321:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607424 00000100:00100000:3.0:1787380376.946376:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 278 00000100:00100000:3.0:1787380376.946383:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915607424:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380376.946417:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915607424:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 34us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380376.946423:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 278 00000100:00080000:1.0:1787380376.947059:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380376.947066:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787380377.084898:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380378.103558:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380379.127925:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787380379.769695:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787380380.152412:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380380.408021:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935567104:0@lo:400:kworker.0 00000100:00100000:2.0:1787380380.408152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380380.408281:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935567104 00000100:00100000:3.0:1787380380.408295:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935567104 00000100:00100000:3.0:1787380380.408570:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787380380.408582:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935567104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380380.409014:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935567232:0@lo:400:kworker.0 00000100:00100000:1.0:1787380380.409067:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380380.409285:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935567232 00000100:00100000:1.0:1787380380.409293:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935567232 00000100:00100000:1.0:1787380380.409371:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787380380.409400:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935567232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380380.409455:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935567232:12345-0@lo:400:kworker.0 Request processed in 57us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380380.409463:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787380380.409516:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935567232:0@lo:400:kworker.0 00000100:00100000:3.0:1787380380.415790:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935567104:12345-0@lo:400:kworker.0 Request processed in 7198us (7625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380380.415810:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787380380.416791:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380380.416814:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935567616:0@lo:400:kworker.0 00000100:00100000:0.0:1787380380.416899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380380.416983:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935567104:0@lo:400:kworker.0 00000100:00100000:2.0:1787380380.417285:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935567488:0@lo:400:kworker.0 00000100:00100000:2.0:1787380380.417324:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380380.417369:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380380.417375:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935567360:0@lo:400:kworker.0 00000100:00100000:2.0:1787380380.417402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380380.417434:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935567488 00000100:00100000:2.0:1787380380.417443:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935567488 00000100:00100000:2.0:1787380380.417525:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787380380.417536:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935567488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380380.417592:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935567488:12345-0@lo:400:kworker.0 Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380380.417600:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787380380.417623:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935567616 00000100:00100000:2.0:1787380380.417626:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935567616 00000100:00100000:0.0:1787380380.417663:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935567360 00000100:00100000:0.0:1787380380.417667:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935567360 00000100:00100000:2.0:1787380380.417669:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787380380.417677:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935567616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380380.417696:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787380380.417702:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935567360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380380.417738:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935567616:12345-0@lo:400:kworker.0 Request processed in 62us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.417738:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935567360:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380380.417745:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1787380380.417761:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380380.417767:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380380.417790:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935567360:0@lo:400:kworker.0 00000100:00100000:2.0:1787380380.417802:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935567488:0@lo:400:kworker.0 00000100:00100000:0.0:1787380380.418131:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787380380.418421:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935567744:0@lo:400:kworker.0 00000100:00100000:1.0:1787380380.418465:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380380.418496:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935567616:0@lo:400:kworker.0 00000100:00100000:0.0:1787380380.418874:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935567744 00000100:00100000:0.0:1787380380.418881:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935567744 00000100:00100000:0.0:1787380380.418948:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787380380.418957:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935567744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380380.419031:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935567744:12345-0@lo:400:kworker.0 Request processed in 75us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.419038:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1787380380.419070:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96911bd880 x1874203935567744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380380.419091:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935567744:0@lo:400:kworker.0 00000100:00080000:1.0:1787380380.420647:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380380.920438:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380380.920473:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935567872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380380.920569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380380.920852:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935567872 00000100:00100000:1.0:1787380380.920960:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935567872 00000100:00100000:1.0:1787380380.921083:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380380.921095:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935567872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380380.921140:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380380.921205:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935567872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380380.921212:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787380380.921300:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96911bc380 x1874203935567872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380380.921319:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935567872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380381.176952:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380381.943637:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935568000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380381.943718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380381.945830:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568000 00000100:00100000:0.0:1787380381.945841:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568000 00000100:00100000:0.0:1787380381.945963:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787380381.945974:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935568000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380381.946013:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380381.946096:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935568000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380381.946103:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380381.946203:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935568000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380382.079389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380382.079430:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380382.079502:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380382.079612:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915607936 00000100:00100000:0.0:1787380382.079622:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915607936 00000100:00100000:0.0:1787380382.079671:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 280 00000100:00100000:0.0:1787380382.079679:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2355:x1874203915607936:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380382.079753:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2355:x1874203915607936:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 74us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380382.079773:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 280 00000100:00100000:1.0:1787380382.080380:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608064 00000100:00100000:1.0:1787380382.080390:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608064 00000100:00100000:1.0:1787380382.080436:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 119 00000100:00100000:1.0:1787380382.080444:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915608064:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380382.080502:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915608064:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 60us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.080509:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 119 00000100:00080000:0.0:1787380382.082740:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380382.090919:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608192 00000100:00100000:3.0:1787380382.090933:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608192 00000100:00100000:3.0:1787380382.091083:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1787380382.091093:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2352:x1874203915608192:12345-192.168.206.14@tcp:9:kworker.0 00000020:00000080:3.0:1787380382.091121:0:8465:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188425c5 00000100:00080000:3.0:1787380382.091130:0:8465:0:(import.c:65:import_set_state_nolock()) ffff9d9698d8a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787380382.091180:0:8465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787380382.093034:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+2:2352:x1874203915608192:12345-192.168.206.14@tcp:9:kworker.0 Request processed in 1934us (13522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.093048:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:2.0:1787380382.093162:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:0.0:1787380382.093396:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380382.094834:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608320 00000100:00100000:3.0:1787380382.094846:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608320 00000100:00080000:1.0:1787380382.105150:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380382.105180:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380382.105589:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:3.0:1787380382.105613:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915608320:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380382.105952:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915608320:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 342us (12788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.105961:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 120 00010000:00010000:2.0:1787380382.201104:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380383.225680:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380384.263443:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380385.271663:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380385.527786:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935568512:0@lo:400:kworker.0 00000100:00100000:2.0:1787380385.527884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380385.527948:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380385.527954:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935568384:0@lo:400:kworker.0 00000100:00100000:2.0:1787380385.527978:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380385.528011:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568384 00000100:00100000:2.0:1787380385.528019:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568384 00000100:00100000:2.0:1787380385.528072:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787380385.528083:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935568384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380385.528133:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935568384:12345-0@lo:400:kworker.0 Request processed in 53us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380385.528155:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787380385.528202:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935568384:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528321:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935568128:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380385.528412:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b515a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935568640:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528432:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380385.528449:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787380385.528455:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935568256:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380385.528489:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935568768:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528508:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380385.528547:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568128 00000100:00100000:3.0:1787380385.528551:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568128 00000100:00100000:3.0:1787380385.528578:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787380385.528585:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935568128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528617:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935568128:12345-0@lo:400:kworker.0 Request processed in 33us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380385.528633:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787380385.528662:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568512 00000100:00100000:3.0:1787380385.528666:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568512 00000100:00100000:3.0:1787380385.528690:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568768 00000100:00100000:3.0:1787380385.528693:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568768 00000100:00100000:3.0:1787380385.528712:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787380385.528718:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935568512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528748:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935568512:12345-0@lo:400:kworker.0 Request processed in 30us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380385.528754:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787380385.528766:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787380385.528772:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935568768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528798:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935568768:12345-0@lo:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380385.528804:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1787380385.528836:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5159180 x1874203935568768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380385.528848:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935568768:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528857:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935568128:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528878:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568640 00000100:00100000:3.0:1787380385.528881:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568640 00000100:00100000:3.0:1787380385.528906:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568256 00000100:00100000:3.0:1787380385.528909:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568256 00000100:00100000:3.0:1787380385.528921:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787380385.528927:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935568640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.528970:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935568640:12345-0@lo:400:kworker.0 Request processed in 43us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380385.528976:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787380385.528987:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787380385.528992:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935568256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.529016:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935568256:12345-0@lo:400:kworker.0 Request processed in 24us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380385.529021:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787380385.529042:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5159f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935568256:0@lo:400:kworker.0 00000100:00100000:3.0:1787380385.529050:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935568640:0@lo:400:kworker.0 00000100:00080000:1.0:1787380385.529687:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380385.529693:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380385.529695:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380385.529830:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b515bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935568512:0@lo:400:kworker.0 00000100:00100000:3.0:1787380386.039709:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935568896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380386.039788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380386.040063:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935568896 00000100:00100000:1.0:1787380386.040071:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935568896 00000100:00100000:1.0:1787380386.040124:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787380386.040134:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935568896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380386.040179:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380386.040254:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935568896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380386.040262:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787380386.040537:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96911bdc00 x1874203935568896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380386.040557:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935568896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380386.295798:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787380386.607550:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:2.0:1787380386.607560:0:6603:0:(genops.c:906:class_export_put()) final put ffff9d9698d8b800/7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:0.0:1787380386.607646:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9698d8b800/7dca2b77-2f7d-460b-a508-1b61c3cf2401 for lustre-OST0000 00000020:00000080:0.0:1787380386.607697:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d9698d8a800 for lustre-OST0000 00000100:00100000:0.0:1787380387.063910:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380387.063935:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935569024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380387.064011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380387.064091:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569024 00000100:00100000:0.0:1787380387.064099:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569024 00000100:00100000:0.0:1787380387.064168:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380387.064178:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935569024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380387.064220:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787380387.064462:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380387.065132:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935569024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 950us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.065143:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787380387.065585:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935569024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380387.185185:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380387.185251:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380387.185283:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380387.185377:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608448 00000100:00100000:0.0:1787380387.185389:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608448 00000100:00100000:0.0:1787380387.185473:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 282 00000100:00100000:0.0:1787380387.185485:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915608448:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380387.185580:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915608448:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.185589:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 282 00000100:00100000:3.0:1787380387.186258:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608576 00000100:00100000:3.0:1787380387.186266:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608576 00000100:00100000:3.0:1787380387.186362:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608704 00000100:00100000:3.0:1787380387.186365:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608704 00000100:00100000:3.0:1787380387.186391:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 124 00000100:00100000:3.0:1787380387.186399:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915608576:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380387.186469:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915608576:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 70us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.186476:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 124 00000100:00100000:3.0:1787380387.186507:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 125 00000100:00100000:3.0:1787380387.186513:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915608704:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380387.186536:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915608704:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 24us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.186544:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 125 00000100:00080000:0.0:1787380387.187031:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787380387.320413:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380388.344508:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380389.373927:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787380390.009180:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380390.391807:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380390.655391:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935569408:0@lo:400:kworker.0 00000100:00100000:0.0:1787380390.655517:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935569280:0@lo:400:kworker.0 00000100:00100000:2.0:1787380390.655570:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935569152:0@lo:400:kworker.0 00000100:00100000:1.0:1787380390.658437:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935569536:0@lo:400:kworker.0 00000100:00100000:0.0:1787380390.658563:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380390.658619:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935569792:0@lo:400:kworker.0 00000100:00100000:0.0:1787380390.658645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380390.665321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380390.665389:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935569664:0@lo:400:kworker.0 00000100:00100000:2.0:1787380390.665435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380390.665500:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569152 00000100:00100000:2.0:1787380390.665508:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569152 00000100:00100000:2.0:1787380390.665553:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787380390.665561:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935569152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380390.665613:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96988b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935569152:12345-0@lo:400:kworker.0 Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380390.665620:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787380390.665666:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935569152:0@lo:400:kworker.0 00000100:00100000:3.0:1787380390.666202:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569280 00000100:00100000:3.0:1787380390.666209:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569280 00000100:00100000:3.0:1787380390.666261:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569664 00000100:00100000:3.0:1787380390.666265:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569664 00000100:00100000:3.0:1787380390.666295:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787380390.666303:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935569280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380390.666374:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935569280:12345-0@lo:400:kworker.0 Request processed in 72us (7812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380390.666381:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787380390.666393:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787380390.666399:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380390.667902:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935569664:12345-0@lo:400:kworker.0 Request processed in 1498us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380390.667915:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787380390.667958:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569792 00000100:00100000:3.0:1787380390.667963:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569792 00000100:00100000:3.0:1787380390.667999:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787380390.668006:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935569792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380390.668053:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935569792:12345-0@lo:400:kworker.0 Request processed in 47us (9407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380390.668074:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1787380390.668090:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380390.668094:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380390.668136:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935569280:0@lo:400:kworker.0 00010000:00080000:3.0:1787380390.668151:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5d4f100 x1874203935569792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380390.668162:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935569792:0@lo:400:kworker.0 00000100:00100000:3.0:1787380390.668317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380390.668356:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569408 00000100:00100000:3.0:1787380390.668359:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569408 00000100:00100000:3.0:1787380390.668391:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787380390.668397:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935569408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380390.668937:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935569664:0@lo:400:kworker.0 00000100:00100000:3.0:1787380390.669062:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935569408:12345-0@lo:400:kworker.0 Request processed in 663us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380390.669069:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1787380390.669086:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380390.669113:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935569408:0@lo:400:kworker.0 00000100:00100000:1.0:1787380390.671985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380390.678534:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569536 00000100:00100000:2.0:1787380390.678549:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569536 00000100:00100000:2.0:1787380390.678628:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787380390.678640:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935569536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380390.678736:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935569536:12345-0@lo:400:kworker.0 Request processed in 99us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380390.678743:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787380390.678872:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380390.679990:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935569536:0@lo:400:kworker.0 00000001:02000400:1.0:1787380390.958651:0:11699:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:33:09 (1787380389) 00000100:00100000:3.0:1787380391.159587:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935569920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380391.159648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380391.159854:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935569920 00000100:00100000:1.0:1787380391.159861:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935569920 00000100:00100000:1.0:1787380391.159905:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787380391.159913:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935569920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380391.159942:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380391.159986:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935569920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380391.159992:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787380391.160084:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96911bdc00 x1874203935569920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380391.160100:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935569920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787380391.417389:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380392.184976:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935570048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380392.185045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380392.185297:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935570048 00000100:00100000:1.0:1787380392.185304:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935570048 00000100:00100000:1.0:1787380392.185385:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787380392.185395:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935570048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380392.185437:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380392.185482:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935570048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380392.185489:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787380392.185531:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935570048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787380392.185762:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380392.305860:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380392.305904:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380392.305944:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380392.306042:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915609088 00000100:00100000:1.0:1787380392.306051:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915609088 00000100:00100000:1.0:1787380392.306125:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608960 00000100:00100000:1.0:1787380392.306129:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608960 00000100:00100000:1.0:1787380392.306153:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 129 00000100:00100000:1.0:1787380392.306162:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915609088:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380392.306246:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915609088:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 84us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380392.306253:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 129 00000100:00100000:1.0:1787380392.306271:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 130 00000100:00100000:1.0:1787380392.306278:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915608960:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380392.306307:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915608960:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380392.306313:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 130 00000100:00080000:2.0:1787380392.306757:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380392.307010:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915608832 00000100:00100000:3.0:1787380392.307015:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915608832 00000100:00100000:3.0:1787380392.307074:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 284 00000100:00100000:3.0:1787380392.307082:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915608832:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380392.307130:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915608832:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 49us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380392.307136:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 284 00010000:00010000:2.0:1787380392.441787:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380392.442256:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380392.442362:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915609216 00000100:00100000:1.0:1787380392.442371:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915609216 00000100:00100000:1.0:1787380392.442471:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:1.0:1787380392.442493:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:10203:x1874203915609216:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380392.442512:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380392.442531:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6749 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380392.442590:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380392.442615:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380392.442628:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380392.442807:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787380392.442811:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380392.442909:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380392.442932:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6749 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380392.442948:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6749 expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380392.442956:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968911da00) 00010000:00010000:1.0:1787380392.442958:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380392.442961:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e400, rc 0) 00000100:00100000:1.0:1787380392.443026:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:10203:x1874203915609216:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 534us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380392.443042:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:0.0:1787380392.454530:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380392.454766:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915609344 00000100:00100000:3.0:1787380392.454776:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915609344 00000100:00100000:3.0:1787380392.454839:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:3.0:1787380392.454848:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:10204:x1874203915609344:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380392.454876:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380392.454895:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d11884269e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6750 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.454949:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.454962:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.454973:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.454986:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.454993:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.454999:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455446:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d1188426b3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455455:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d1188426b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455463:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d1188426b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380392.455551:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787380392.455556:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380392.455643:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d1188426b3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455654:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455661:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455667:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455672:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380392.455676:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455683:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455694:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968911da00) 00010000:00010000:3.0:1787380392.455703:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380392.455708:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455713:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188426a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455726:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455731:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455737:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455742:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380392.455745:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455750:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455757:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d968727f900) 00010000:00010000:3.0:1787380392.455760:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380392.455762:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455767:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188426ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455798:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d11884269e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6750 expref: 8 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455824:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d1188426b3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6750 expref: 7 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.455832:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d968727fe00) 00010000:00010000:3.0:1787380392.455834:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380392.455836:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163aa00, rc 0) 00000100:00100000:3.0:1787380392.455889:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:10204:x1874203915609344:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1042us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380392.455898:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:0.0:1787380392.461735:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380392.464291:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915609600 00000100:00100000:3.0:1787380392.464306:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915609600 00000100:00100000:3.0:1787380392.464463:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:3.0:1787380392.464474:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:10204:x1874203915609600:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380392.464494:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380392.464515:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d1188426ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6757 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.464619:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.464634:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.464644:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.464659:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.464674:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.464682:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465195:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188426cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465219:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188426cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465228:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188426cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380392.465238:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787380392.465479:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465488:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465496:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465502:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54e00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380392.465506:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465513:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465537:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d968727fe00) 00010000:00010000:3.0:1787380392.465540:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380392.465545:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465551:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d1188426c1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465563:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465569:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465575:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465580:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380392.465583:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465589:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465597:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d968727f100) 00010000:00010000:3.0:1787380392.465599:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380392.465602:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465607:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d1188426c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.465988:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d1188426ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6757 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.466004:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188426cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6757 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380392.466011:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:3.0:1787380392.466014:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380392.466016:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54800, rc 0) 00000100:00100000:3.0:1787380392.466095:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:10204:x1874203915609600:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1623us (4367us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787380392.466103:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:2.0:1787380392.471466:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380392.471652:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915609728 00000100:00100000:3.0:1787380392.471664:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915609728 00000100:00100000:3.0:1787380392.471727:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:3.0:1787380392.471737:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:10204:x1874203915609728:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787380392.471845:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:10204:x1874203915609728:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380392.471852:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 35 00000040:00080000:2.0:1787380393.088321:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380393.464655:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380394.173994:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380394.176768:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915609856 00000100:00100000:1.0:1787380394.176781:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915609856 00000100:00100000:1.0:1787380394.176848:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:1.0:1787380394.176860:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:10246:x1874203915609856:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380394.176882:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380394.176902:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f675e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.176975:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.176989:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177001:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177014:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177021:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177027:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177293:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177311:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177317:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177322:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380394.177326:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177333:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177361:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968911da00) 00010000:00010000:1.0:1787380394.177364:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380394.177368:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177374:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188426e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177385:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177391:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177397:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177402:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fc00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380394.177410:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177417:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177425:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d968911d400) 00010000:00010000:1.0:1787380394.177427:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380394.177430:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177436:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177467:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f675e expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177477:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968911da00) 00010000:00010000:1.0:1787380394.177479:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380394.177482:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f675e expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.177491:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fa00, rc 0) 00000100:00100000:1.0:1787380394.177556:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:10246:x1874203915609856:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 697us (3568us total) trans 0 rc 301/301 00000100:00100000:1.0:1787380394.177563:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00080000:2.0:1787380394.178379:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380394.188694:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.189104:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915610112 00000100:00100000:0.0:1787380394.189114:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915610112 00000100:00100000:1.0:1787380394.189464:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:1.0:1787380394.189474:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:10246:x1874203915610112:12345-192.168.206.14@tcp:36:lfs.0 00010000:00010000:1.0:1787380394.189531:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380394.189556:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6749 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.189571:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968911da00) 00010000:00010000:1.0:1787380394.189582:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380394.189869:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.189882:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.189893:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.189905:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.189912:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.189919:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380394.192391:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787380394.192409:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.192420:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.192427:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.192441:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fa00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380394.192446:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.192454:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.192470:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380394.192473:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380394.192477:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.192484:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188426f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380394.192502:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbce6bdd reply state 000000009e228896 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380394.192510:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380394.192620:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:10246:x1874203915610112:12345-192.168.206.14@tcp:36:lfs.0 Request processed in 3145us (3946us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787380394.192629:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 37 00010000:00010000:0.0:1787380394.198374:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.198390:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.198398:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.198405:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fc00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.198410:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.198417:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.198434:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d968911df00) 00010000:00010000:0.0:1787380394.198437:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.198442:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.198460:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188426f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380394.261608:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380394.267040:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915610240 00000100:00100000:2.0:1787380394.267053:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915610240 00000100:00100000:3.0:1787380394.267190:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:3.0:1787380394.267210:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:10254:x1874203915610240:12345-192.168.206.14@tcp:101:lctl.0 00010000:00010000:3.0:1787380394.267238:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380394.267263:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6765 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.267369:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d118842707 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.267383:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d118842707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.267393:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d118842707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380394.267755:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787380394.267759:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380394.267800:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d118842707 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.267825:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6765 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.267843:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d118842707 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6765 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.267851:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:3.0:1787380394.267854:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380394.267857:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55400, rc 0) 00000100:00100000:3.0:1787380394.267922:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:10254:x1874203915610240:12345-192.168.206.14@tcp:101:lctl.0 Request processed in 722us (6323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380394.267930:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:3.0:1787380394.345579:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.346205:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915610368 00000100:00100000:0.0:1787380394.346216:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915610368 00000100:00100000:0.0:1787380394.346285:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:0.0:1787380394.346297:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:10260:x1874203915610368:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:0.0:1787380394.346320:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380394.346379:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884270e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f676c expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346446:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346460:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346470:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346483:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346490:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346496:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346599:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118842723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346636:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118842723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346642:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118842723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380394.346677:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787380394.346681:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380394.346719:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118842723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346731:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346738:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346744:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346750:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.346754:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346762:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346773:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:0.0:1787380394.346776:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.346781:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346797:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346809:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346815:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346821:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346826:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ea00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.346829:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346835:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346844:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d96991e8600) 00010000:00010000:0.0:1787380394.346846:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.346849:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346854:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d11884271c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346886:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884270e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f676c expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346900:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118842723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f676c expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.346913:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:0.0:1787380394.346916:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787380394.346918:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e000, rc 0) 00000100:00100000:0.0:1787380394.346980:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10260:x1874203915610368:12345-192.168.206.14@tcp:101:bash.0 Request processed in 685us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.346987:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:2.0:1787380394.351495:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380394.358390:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915610624 00000100:00100000:1.0:1787380394.358478:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915610624 00000100:00100000:1.0:1787380394.362423:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:1.0:1787380394.362457:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10260:x1874203915610624:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:0.0:1787380394.362501:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380394.362527:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d11884272a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6773 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.362675:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.362690:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.362713:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.362728:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.362735:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.362741:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380394.363290:0:5787:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787380394.363498:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363509:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363517:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363548:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363556:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363562:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363569:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.363573:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363580:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363591:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:0.0:1787380394.363593:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.363598:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363603:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842731 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380394.363624:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b684a76d reply state 0000000021950142 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.363632:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787380394.363661:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d11884272a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363674:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.363681:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d96991e8600) 00010000:00010000:0.0:1787380394.363684:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380394.363686:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380394.363766:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10260:x1874203915610624:12345-192.168.206.14@tcp:101:bash.0 Request processed in 1313us (12281us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787380394.363775:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 40 00010000:00010000:0.0:1787380394.365647:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.365663:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.365671:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.365677:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.365682:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.365707:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.365724:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d96991e8a00) 00010000:00010000:0.0:1787380394.365728:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.365732:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.365739:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842738 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380394.376539:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380394.376713:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915610752 00000100:00100000:3.0:1787380394.376729:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915610752 00000100:00100000:2.0:1787380394.377037:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:2.0:1787380394.377046:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874203915610752:12345-192.168.206.14@tcp:8:bash.0 00010000:00080000:2.0:1787380394.377088:0:6577:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp t0 exp 0000000000000000 cur 344 last 0 00000020:00000080:2.0:1787380394.377117:0:6577:0:(genops.c:1406:class_connect()) connect: client 7dca2b77-2f7d-460b-a508-1b61c3cf2401, cookie 0x651a07d11884274d 00002000:00100000:2.0:1787380394.377127:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7dca2b77-2f7d-460b-a508-1b61c3cf2401/ffff9d96b5e4d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787380394.377150:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787380394.377429:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787380394.377567:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9d96b5e4f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380394.377642:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5196a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2352:x1874203915610752:12345-192.168.206.14@tcp:8:bash.0 Request processed in 596us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380394.377650:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:2.0:1787380394.389705:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380394.390536:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915610880 00000100:00100000:3.0:1787380394.390547:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915610880 00000100:00080000:2.0:1787380394.390612:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380394.390669:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:2.0:1787380394.390684:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:0:x1874203915610880:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380394.390701:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380394.390723:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f677a expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380394.390767:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787380394.390786:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1787380394.390791:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380394.390799:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.390818:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.390832:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3c00, rc 0) 00000100:00100000:2.0:1787380394.390925:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5195500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:0:x1874203915610880:12345-192.168.206.14@tcp:101:bash.0 Request processed in 234us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380394.390933:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:0.0:1787380394.400259:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380394.400422:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915611008 00000100:00100000:3.0:1787380394.400433:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915611008 00000100:00100000:3.0:1787380394.400536:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:3.0:1787380394.400547:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:10260:x1874203915611008:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380394.400566:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380394.400587:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6781 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.400616:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 8 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.400625:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380394.400629:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380394.400634:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.400664:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 8 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.400678:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 8 pid: 8465 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380394.400691:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1874203935570176:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380394.400822:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380394.404303:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1874203935570176:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380394.404466:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.404490:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55600, rc 0) 00000100:00100000:0.0:1787380394.404548:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:10260:x1874203915611008:12345-192.168.206.14@tcp:101:bash.0 Request processed in 4003us (4297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.404556:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:1.0:1787380394.408587:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.408831:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915611136 00000100:00100000:0.0:1787380394.408841:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915611136 00010000:00010000:0.0:1787380394.408879:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 8 pid: 8465 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.408922:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:0.0:1787380394.408930:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915611136:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380394.408956:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380394.408977:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 8 pid: 8465 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.408992:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 8 pid: 8465 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.409016:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000503849a3/0x651a07d118842754 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f677a expref: 8 pid: 8465 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.409032:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380394.409037:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380394.409044:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.409054:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.409090:0:5772:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.409104:0:5772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5772:1874203935570304:192.168.206.14@tcp:105: 00000100:00100000:0.0:1787380394.409182:0:5772:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380394.411759:0:5772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5772:1874203935570304:192.168.206.14@tcp:105: 00010000:00010000:0.0:1787380394.411785:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380394.411859:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915611136:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 2928us (3573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.411870:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:3.0:1787380394.413056:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.413111:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915611392 00000100:00100000:0.0:1787380394.413119:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915611392 00000100:00100000:0.0:1787380394.413175:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:0.0:1787380394.413184:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10260:x1874203915611392:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:0.0:1787380394.413576:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10260:x1874203915611392:12345-192.168.206.14@tcp:35:bash.0 Request processed in 391us (524us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787380394.413584:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00010000:00010000:2.0:1787380394.487544:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380394.502521:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.502754:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915611648 00000100:00100000:0.0:1787380394.502765:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915611648 00000100:00100000:0.0:1787380394.502867:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:0.0:1787380394.502878:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10270:x1874203915611648:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380394.502914:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380394.502936:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6788 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380394.503065:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787380394.503212:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842762 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6788 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.503227:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:0.0:1787380394.503230:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380394.503235:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6788 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.503259:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f600, rc 0) 00000100:00100000:0.0:1787380394.503318:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10270:x1874203915611648:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 441us (806us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787380394.503325:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:1.0:1787380394.511889:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.512584:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915611904 00000100:00100000:0.0:1787380394.512595:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915611904 00000100:00100000:0.0:1787380394.512655:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:0.0:1787380394.512666:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10270:x1874203915611904:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380394.512899:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:10270:x1874203915611904:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 235us (1019us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787380394.512908:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:3.0:1787380394.612308:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.613036:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915612032 00000100:00100000:0.0:1787380394.613046:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915612032 00000100:00100000:0.0:1787380394.613162:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:0.0:1787380394.613172:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:10276:x1874203915612032:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380394.613205:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380394.613225:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842770 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f678f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.613285:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.613298:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.613309:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380394.613400:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787380394.613404:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380394.613426:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.613452:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842770 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f678f expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.613470:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f678f expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.613479:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:0.0:1787380394.613482:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380394.613484:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f000, rc 0) 00000100:00100000:0.0:1787380394.613537:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10276:x1874203915612032:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 367us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.613545:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:2.0:1787380394.620070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380394.620249:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915612288 00000100:00100000:1.0:1787380394.620259:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915612288 00000100:00100000:1.0:1787380394.620322:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:1.0:1787380394.620332:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10276:x1874203915612288:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380394.620369:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380394.620389:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884277e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6796 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.620480:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.620495:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.620506:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380394.620518:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787380394.620640:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884277e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6796 expref: 20 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.620657:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6796 expref: 19 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.620665:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d96991e8600) 00010000:00010000:1.0:1787380394.620667:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380394.620670:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f000, rc 0) 00000100:00100000:1.0:1787380394.620740:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5196d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:10276:x1874203915612288:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 410us (678us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787380394.620759:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:1.0:1787380394.628843:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380394.629068:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915612544 00000100:00100000:2.0:1787380394.629077:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915612544 00000100:00100000:2.0:1787380394.629138:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:2.0:1787380394.629149:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:10276:x1874203915612544:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380394.629171:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380394.629190:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f679d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.629294:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884279a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.629326:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884279a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.629379:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884279a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380394.629395:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787380394.629514:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f679d expref: 22 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.629532:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884279a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f679d expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.629540:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d96991e8600) 00010000:00010000:2.0:1787380394.629543:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380394.629546:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3800, rc 0) 00000100:00100000:2.0:1787380394.629605:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10276:x1874203915612544:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 459us (770us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787380394.629612:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:3.0:1787380394.630224:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.630540:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915612672 00000100:00100000:0.0:1787380394.630547:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915612672 00000100:00100000:0.0:1787380394.630588:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:0.0:1787380394.630597:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2356:x1874203915612672:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380394.630624:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380394.630643:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6796 expref: 21 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.630657:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d96991e8600) 00010000:00010000:0.0:1787380394.630666:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380394.630718:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:2356:x1874203915612672:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 122us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.630725:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:3.0:1787380394.647054:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380394.647140:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915612800 00000100:00100000:2.0:1787380394.647151:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915612800 00000100:00100000:2.0:1787380394.647219:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:2.0:1787380394.647230:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915612800:12345-192.168.206.14@tcp:1:lfs.0 00010000:00010000:2.0:1787380394.647272:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.647293:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.647315:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380394.647319:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380394.647324:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.647406:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.647422:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 7 pid: 6576 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380394.647438:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1874203935570432:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380394.647515:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380394.655111:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5195f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1874203935570432:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380394.655142:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380394.655549:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380394.655628:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915612928 00000100:00100000:1.0:1787380394.655636:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915612928 00002000:00100000:1.0:1787380394.655676:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9d96b5d4ca80 x1874203915612928/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:200/0 lens 504/0 e 0 to 0 dl 1787380405 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787380394.655686:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5d4ca80 with x1874203915612928 ext(0->12) 00010000:00010000:1.0:1787380394.655694:0:6582:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 8 pid: 6576 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.655707:0:6582:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 8 pid: 6576 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380394.655715:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96b5d4ca80 00000100:00100000:1.0:1787380394.655751:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1787380394.655761:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915612928:12345-192.168.206.14@tcp:4:lfs.0 00000001:00100000:0.0:1787380394.741834:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000100:00100000:0.0:1787380394.742898:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2355:x1874203915612928:12345-192.168.206.14@tcp:4:lfs.0 Request processed in 87123us (87334us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787380394.742916:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00002000:00100000:0.0:1787380394.742940:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9d96b5d4ca80 x1874203915612928/t4294967299(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:200/0 lens 504/448 e 0 to 0 dl 1787380405 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380394.742951:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5d4ca80 with x1874203915612928 ext(0->12) 00010000:00010000:0.0:1787380394.742961:0:6582:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 9 pid: 6576 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.742981:0:6582:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 9 pid: 6576 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380394.742988:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96b5d4ca80 00000100:00100000:1.0:1787380394.745813:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.746517:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915613056 00000100:00100000:0.0:1787380394.746527:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915613056 00010000:00010000:0.0:1787380394.746569:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 9 pid: 6576 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.746618:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:0.0:1787380394.746627:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915613056:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380394.746641:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787380394.746672:0:5773:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787380394.746675:0:5773:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787380394 00002000:00010000:0.0:1787380394.746677:0:5773:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787380394 00002000:00010000:0.0:1787380394.746679:0:5773:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787380394 00010000:00010000:0.0:1787380394.746686:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 9 pid: 6576 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.746706:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 9 pid: 6576 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.746731:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de79a5ad/0x651a07d11884275b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6781 expref: 9 pid: 6576 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.746745:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1787380394.746749:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380394.746755:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.746765:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.746798:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380394.747148:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915613056:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 519us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.747156:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 36 00010000:00010000:2.0:1787380394.747325:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747367:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747396:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747422:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747430:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747438:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3a00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380394.747442:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747451:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747464:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380394.747472:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5a7dabc/0x651a07d1188427a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380394.747521:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915612800:12345-192.168.206.14@tcp:1:lfs.0 Request processed in 100294us (100476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380394.747530:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:3.0:1787380394.754532:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.754683:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915613312 00000100:00100000:0.0:1787380394.754693:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915613312 00000100:00100000:0.0:1787380394.754782:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:0.0:1787380394.754806:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:10276:x1874203915613312:12345-192.168.206.14@tcp:35:lfs.0 00000004:00010000:0.0:1787380394.754869:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884279a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f679d expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380394.755266:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787380394.755310:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787380394.756253:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787380394.756314:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.756331:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.756397:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.756432:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.756447:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 24 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.756461:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1874203935570560:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380394.756657:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380394.760332:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1874203935570560:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380394.760387:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380394.763706:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.764921:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915613440 00000100:00100000:0.0:1787380394.764933:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915613440 00010000:00010000:0.0:1787380394.764977:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 25 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.765024:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:0.0:1787380394.765033:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+25:2355:x1874203915613440:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380394.765046:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380394.765052:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 25 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.765065:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 25 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.765086:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884273f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6773 expref: 25 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.765101:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d96991e8600) 00010000:00010000:0.0:1787380394.765105:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.765114:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.765121:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.765203:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380394.765281:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:2355:x1874203915613440:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 248us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.765289:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 37 00010000:00010000:1.0:1787380394.765608:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380394.765686:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380394.766118:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787380394.766556:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787380394.766663:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935570688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380394.766768:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380394.766803:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380394.767013:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935570688 00000100:00100000:2.0:1787380394.767020:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935570688 00000100:00100000:2.0:1787380394.767092:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380394.767113:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1874203935570688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787380394.767279:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935570688:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1787380394.767500:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380394.767572:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1874203935570688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380394.767580:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1787380394.768011:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787380394.768374:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935570816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787380394.768421:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380394.768455:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380394.768603:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935570816 00000100:00100000:2.0:1787380394.768608:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935570816 00000100:00100000:2.0:1787380394.768653:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380394.768662:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1874203935570816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787380394.769036:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1874203935570816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 374us (614us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787380394.769044:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380394.769168:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935570816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787380394.769235:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787380394.769278:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.769289:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.769296:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.769303:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380394.769308:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.769315:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.769509:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d96991e8600) 00010000:00010000:3.0:1787380394.769513:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787380394.769518:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.769524:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188427af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380394.769707:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787380394.769922:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787380394.769941:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345081602331ns, next at 346081600440ns, rc = 0 00000001:00080000:3.0:1787380394.769947:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787380394.769982:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d96991e8600) 00010000:00010000:3.0:1787380394.769985:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787380394.769993:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884279a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f679d expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380394.770223:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:10276:x1874203915613312:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 15417us (15698us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787380394.770232:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000020:00080000:3.0:1787380394.770236:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787380394.774654:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380394.774773:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915613568 00000100:00100000:3.0:1787380394.774800:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915613568 00000100:00100000:3.0:1787380394.774863:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:3.0:1787380394.774873:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:10276:x1874203915613568:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380394.774897:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380394.774920:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d1188427b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67a4 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.774999:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d1188427b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67a4 expref: 28 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.775013:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d1188427b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67a4 expref: 28 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380394.775031:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380394.775035:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380394.775038:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54c00, rc 0) 00000100:00100000:3.0:1787380394.775157:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:10276:x1874203915613568:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 284us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380394.775164:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:2.0:1787380394.777846:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380394.777944:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915613824 00000100:00100000:1.0:1787380394.777953:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915613824 00000100:00100000:1.0:1787380394.778048:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:1.0:1787380394.778058:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e19850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:10276:x1874203915613824:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380394.778302:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e19850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:10276:x1874203915613824:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 245us (462us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787380394.778310:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:2.0:1787380394.865288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.865775:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915614080 00000100:00100000:0.0:1787380394.865784:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915614080 00000100:00100000:0.0:1787380394.865851:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:0.0:1787380394.865861:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:10286:x1874203915614080:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380394.865883:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380394.865902:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67ab expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380394.866009:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787380394.866118:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ab expref: 31 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.866133:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:0.0:1787380394.866136:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380394.866142:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ab expref: 31 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.866157:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380394.866234:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5195f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:10286:x1874203915614080:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 374us (956us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787380394.866254:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:2.0:1787380394.875570:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.875673:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915614208 00000100:00100000:0.0:1787380394.875682:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915614208 00000100:00100000:0.0:1787380394.875743:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:0.0:1787380394.875753:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:10286:x1874203915614208:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:0.0:1787380394.875826:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875841:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875853:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875866:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875873:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875892:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875985:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875993:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.875999:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380394.876049:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876061:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876067:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876072:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876078:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.876081:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876087:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876098:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:0.0:1787380394.876101:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.876105:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876110:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876122:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876128:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876139:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876144:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ea00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.876147:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876153:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876160:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d96991e8a00) 00010000:00010000:0.0:1787380394.876162:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.876165:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876170:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876184:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876190:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876208:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876213:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.876216:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876232:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876241:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380394.876243:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.876246:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.876252:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.876335:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:10286:x1874203915614208:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 582us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.876393:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:2.0:1787380394.878772:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380394.878852:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915614464 00000100:00100000:3.0:1787380394.878861:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915614464 00000100:00100000:3.0:1787380394.878915:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:3.0:1787380394.878925:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:10286:x1874203915614464:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:3.0:1787380394.879150:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:10286:x1874203915614464:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 226us (386us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787380394.879158:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:2.0:1787380394.935299:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.939478:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915614720 00000100:00100000:0.0:1787380394.939493:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915614720 00000100:00100000:0.0:1787380394.939570:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:0.0:1787380394.939582:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:10289:x1874203915614720:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380394.939605:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380394.939625:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67b2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.939695:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.939709:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.939720:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.939747:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.939754:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.939760:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.939991:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940000:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940008:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380394.940017:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787380394.940113:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940121:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940128:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940133:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ea00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.940137:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940155:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940168:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:0.0:1787380394.940171:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.940175:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940181:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d1188427e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940206:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940213:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940219:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940224:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.940227:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940233:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940241:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d96991e8a00) 00010000:00010000:0.0:1787380394.940244:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380394.940246:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940264:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188427ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.940318:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188427e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 34 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.941112:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 33 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.941120:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380394.941122:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380394.941125:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f400, rc 0) 00000100:00100000:0.0:1787380394.941206:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5194a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:10289:x1874203915614720:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1626us (5926us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787380394.941215:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:2.0:1787380394.944970:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.945039:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915614848 00000100:00100000:0.0:1787380394.945049:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915614848 00000100:00100000:0.0:1787380394.945111:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:0.0:1787380394.945121:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:10289:x1874203915614848:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:0.0:1787380394.945186:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945212:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945224:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945266:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945273:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945279:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945285:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380394.945301:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945308:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945330:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380394.945333:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380394.945368:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380394.945376:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380394.945651:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:10289:x1874203915614848:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 530us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380394.945660:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:2.0:1787380394.951863:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380394.951960:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915615104 00000100:00100000:0.0:1787380394.951969:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915615104 00000100:00100000:0.0:1787380394.952027:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:0.0:1787380394.952050:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:10289:x1874203915615104:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380394.952299:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:10289:x1874203915615104:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 250us (444us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787380394.952307:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:2.0:1787380395.205962:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380395.206242:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915615360 00000100:00100000:1.0:1787380395.206253:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915615360 00000100:00100000:1.0:1787380395.206327:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:1.0:1787380395.206365:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:10320:x1874203915615360:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:1.0:1787380395.206391:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380395.206411:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884280a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67b9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.206506:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.206520:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.206530:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380395.206541:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787380395.206675:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884280a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b9 expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.206693:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b9 expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.206720:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380395.206723:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380395.206727:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e600, rc 0) 00000100:00100000:1.0:1787380395.206792:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:10320:x1874203915615360:12345-192.168.206.14@tcp:101:cat.0 Request processed in 455us (838us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787380395.206799:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:3.0:1787380395.211528:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380395.211571:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380395.211659:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915615616 00000100:00100000:1.0:1787380395.211669:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915615616 00000100:00100000:1.0:1787380395.211730:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:1.0:1787380395.211740:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:10320:x1874203915615616:12345-192.168.206.14@tcp:35:cat.0 00000100:00100000:1.0:1787380395.211983:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:10320:x1874203915615616:12345-192.168.206.14@tcp:35:cat.0 Request processed in 244us (462us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787380395.211991:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:2.0:1787380395.212074:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915615744 00000100:00100000:2.0:1787380395.212078:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915615744 00000100:00100000:2.0:1787380395.212114:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:2.0:1787380395.212122:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:2354:x1874203915615744:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380395.212133:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380395.212155:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b9 expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380395.212203:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:2.0:1787380395.212209:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380395.212227:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:2354:x1874203915615744:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 107us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380395.212234:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:2.0:1787380395.305631:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380395.305787:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915616000 00000100:00100000:3.0:1787380395.305796:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915616000 00000100:00100000:3.0:1787380395.305855:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:3.0:1787380395.305864:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:10326:x1874203915616000:12345-192.168.206.14@tcp:101:dd.0 00010000:00010000:3.0:1787380395.305909:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380395.305912:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787380395.305936:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f678f expref: 36 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.305955:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380395.305960:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380395.305972:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d11884281f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67c0 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.306065:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.306078:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.306086:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.306114:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.306125:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 36 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380395.306138:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935570944:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380395.306243:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380395.316455:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380395.316545:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915616128 00000100:00100000:1.0:1787380395.316555:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915616128 00010000:00010000:1.0:1787380395.316595:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 37 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380395.316638:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:1.0:1787380395.316648:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:2355:x1874203915616128:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380395.316662:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380395.316669:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 37 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.316683:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 37 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.316718:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380395.316723:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.316732:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.316739:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.316759:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380395.316821:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:2355:x1874203915616128:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 173us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380395.316829:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 38 00010000:00010000:3.0:1787380395.317144:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188427f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67b2 expref: 36 pid: 5787 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380395.317167:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935570944:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380395.317188:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.317207:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.317213:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380395.317232:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787380395.317477:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d11884281f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 37 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.317494:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 36 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.317501:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380395.317503:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380395.317506:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55c00, rc 0) 00000100:00100000:3.0:1787380395.317547:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5194e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:10326:x1874203915616000:12345-192.168.206.14@tcp:101:dd.0 Request processed in 11684us (11925us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787380395.317554:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:0.0:1787380395.326117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380395.326221:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915616384 00000100:00100000:1.0:1787380395.326232:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915616384 00000100:00100000:1.0:1787380395.326293:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:1.0:1787380395.326304:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:10326:x1874203915616384:12345-192.168.206.14@tcp:36:dd.0 00010000:00010000:1.0:1787380395.326595:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.326612:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.326624:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380395.326672:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787380395.326696:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f383a9d4 reply state 0000000015b2c113 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380395.326720:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380395.326805:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+39:10326:x1874203915616384:12345-192.168.206.14@tcp:36:dd.0 Request processed in 502us (697us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787380395.326813:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 52 00000020:00080000:1.0:1787380395.326818:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787380395.333137:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.333154:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.333163:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.333168:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380395.333173:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.333180:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.333205:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380395.333208:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380395.333212:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.333218:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842834 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380395.511721:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380395.608729:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380395.609032:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915616512 00000100:00100000:3.0:1787380395.609042:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915616512 00000100:00100000:3.0:1787380395.609106:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:3.0:1787380395.609116:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:10340:x1874203915616512:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:3.0:1787380395.609148:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380395.609168:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d11884283b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67c7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609240:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609253:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609264:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609278:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609284:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609291:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609443:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609455:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 39 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609462:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609491:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 39 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.609511:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 39 pid: 7761 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380395.609853:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935571072:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380395.610567:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787380395.615904:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380395.616102:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935571072:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380395.616130:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380395.616235:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915616768 00000100:00100000:0.0:1787380395.616243:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915616768 00000100:00100000:0.0:1787380395.616298:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:0.0:1787380395.616307:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:5568:x1874203915616768:12345-192.168.206.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787380395.617124:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:5568:x1874203915616768:12345-192.168.206.14@tcp:35:ldlm_bl.0 Request processed in 814us (1226us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787380395.617133:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:2.0:1787380395.620830:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380395.621052:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915616896 00000100:00100000:0.0:1787380395.621061:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915616896 00010000:00010000:0.0:1787380395.621103:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 41 pid: 7761 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380395.621182:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:0.0:1787380395.621202:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:2355:x1874203915616896:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380395.621217:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380395.621224:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 41 pid: 7761 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.621237:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 41 pid: 7761 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.621258:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55c00/0x651a07d118842826 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c0 expref: 41 pid: 7761 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.621274:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380395.621278:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.621303:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.621311:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.621379:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380395.621439:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5194380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:2355:x1874203915616896:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 247us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380395.621448:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 39 00010000:00010000:3.0:1787380395.621557:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.621575:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380395.621620:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787380395.621624:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380395.623296:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623314:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623325:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623331:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623357:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623363:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380395.623367:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623375:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623403:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:1.0:1787380395.623407:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380395.623418:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623424:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54600/0x651a07d118842842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623438:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623443:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623448:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623452:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380395.623455:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623461:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623469:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968727f400) 00010000:00010000:1.0:1787380395.623471:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380395.623474:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623479:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55600/0x651a07d118842849 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623523:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54e00/0x651a07d11884283b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c7 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623548:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c7 expref: 39 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.623555:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380395.623557:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380395.623559:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b200, rc 0) 00000100:00100000:1.0:1787380395.624117:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+39:10340:x1874203915616512:12345-192.168.206.14@tcp:101:stat.0 Request processed in 14998us (15393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380395.624128:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:2.0:1787380395.715942:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380395.716831:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915617152 00000100:00100000:1.0:1787380395.716841:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915617152 00000100:00100000:1.0:1787380395.716910:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:1.0:1787380395.716919:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+39:10346:x1874203915617152:12345-192.168.206.14@tcp:36:truncate.0 00010000:00010000:1.0:1787380395.716972:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380395.717010:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d118842850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67c7 expref: 39 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.717030:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380395.717035:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380395.717229:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.717241:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.717251:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380395.717308:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787380395.717331:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006858d1b0 reply state 00000000101299d3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380395.719158:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380395.719316:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5195c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:10346:x1874203915617152:12345-192.168.206.14@tcp:36:truncate.0 Request processed in 2394us (3380us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787380395.719325:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 54 00000020:00080000:1.0:1787380395.719331:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787380395.726172:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.726200:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.726209:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.726215:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380395.726220:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.726228:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.726244:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380395.726247:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380395.726252:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380395.726277:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842857 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380395.771006:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935571200:0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380395.771134:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935571712:0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380395.771202:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787380395.771209:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935571328:0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771233:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380395.771251:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935571840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380395.771304:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935571840 00000100:00100000:2.0:1787380395.771311:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935571840 00000100:00100000:2.0:1787380395.771391:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787380395.771411:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935571840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771463:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935571840:12345-0@lo:400:kworker.0 Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380395.771485:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787380395.771524:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935571840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771546:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935571712 00000100:00100000:2.0:1787380395.771549:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935571712 00000100:00100000:2.0:1787380395.771602:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935571328 00000100:00100000:2.0:1787380395.771605:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935571328 00000100:00100000:2.0:1787380395.771623:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787380395.771873:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935571712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771915:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5194000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935571712:12345-0@lo:400:kworker.0 Request processed in 45us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380395.771921:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787380395.771934:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787380395.771940:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935571328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.771969:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5196680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935571328:12345-0@lo:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380395.771974:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787380395.771990:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380395.772011:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935571328:0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.772019:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935571712:0@lo:400:kworker.0 00000100:00100000:1.0:1787380395.772107:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935571456:0@lo:400:kworker.0 00000100:00100000:1.0:1787380395.772138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380395.772166:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380395.772173:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935571584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380395.772210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380395.772240:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935571584 00000100:00100000:1.0:1787380395.772244:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935571584 00000100:00100000:1.0:1787380395.772273:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380395.772279:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935571584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380395.772328:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935571584:12345-0@lo:400:kworker.0 Request processed in 35us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380395.772335:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380395.772382:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935571584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380395.772398:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935571456 00000100:00100000:1.0:1787380395.772401:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935571456 00000100:00100000:1.0:1787380395.772425:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787380395.772431:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935571456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380395.772477:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935571456:12345-0@lo:400:kworker.0 Request processed in 46us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380395.772483:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787380395.772509:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935571456:0@lo:400:kworker.0 00000100:00100000:3.0:1787380395.773444:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935571200 00000100:00100000:3.0:1787380395.773452:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935571200 00000100:00100000:3.0:1787380395.773501:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787380395.773509:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935571200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380395.773559:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935571200:12345-0@lo:400:kworker.0 Request processed in 51us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380395.773565:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:2.0:1787380395.775601:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380395.775611:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380395.775673:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935571200:0@lo:400:kworker.0 00000100:00100000:2.0:1787380395.946066:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380395.946852:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915617280 00000100:00100000:1.0:1787380395.946865:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915617280 00000100:00100000:1.0:1787380395.946946:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:1.0:1787380395.946957:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:10360:x1874203915617280:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:1.0:1787380395.946981:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380395.947001:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d11884285e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67ce expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947064:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947078:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947089:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947105:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947112:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947119:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947250:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947258:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947266:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380395.947300:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787380395.947304:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380395.947564:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947587:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947595:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947602:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947978:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947984:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380395.947988:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.947996:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948022:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:1.0:1787380395.948025:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380395.948030:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948036:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948050:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948057:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948063:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948068:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380395.948070:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948076:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948084:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968911d700) 00010000:00010000:1.0:1787380395.948086:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380395.948089:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948095:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884286c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948141:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d11884285e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 42 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948155:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 41 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380395.948162:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380395.948164:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380395.948167:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f000, rc 0) 00000100:00100000:1.0:1787380395.948327:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5194700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:10360:x1874203915617280:12345-192.168.206.14@tcp:101:stat.0 Request processed in 1362us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380395.948377:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:3.0:1787380396.077724:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.077845:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915617536 00000100:00100000:2.0:1787380396.077855:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915617536 00000100:00100000:2.0:1787380396.077954:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:2.0:1787380396.077964:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:10370:x1874203915617536:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380396.077984:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380396.078004:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d11884287a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67d5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380396.078112:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787380396.078237:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d11884287a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67d5 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.078252:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:2.0:1787380396.078255:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380396.078260:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d11884287a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67d5 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.078273:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2600, rc 0) 00000100:00100000:2.0:1787380396.078379:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+42:10370:x1874203915617536:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 377us (623us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787380396.078386:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00080000:0.0:1787380396.078461:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380396.086847:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.086986:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915617792 00000100:00100000:1.0:1787380396.086996:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915617792 00000100:00100000:1.0:1787380396.087081:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:1.0:1787380396.087091:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+42:10370:x1874203915617792:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380396.087377:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:10370:x1874203915617792:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 286us (538us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787380396.087386:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1787380396.149442:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.149666:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915618048 00000100:00100000:2.0:1787380396.149680:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915618048 00000100:00100000:2.0:1787380396.149744:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:2.0:1787380396.149755:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:10376:x1874203915618048:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380396.149779:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380396.149799:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842888 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67dc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.149914:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.149929:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 44 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.149937:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.149966:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 44 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.149978:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 44 pid: 7761 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380396.149990:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5197100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935571968:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380396.150079:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f0d0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380396.153970:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.153983:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5197100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935571968:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380396.154008:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380396.154074:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915618176 00000100:00100000:1.0:1787380396.154081:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915618176 00010000:00010000:1.0:1787380396.154117:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 45 pid: 7761 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380396.154158:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:1.0:1787380396.154167:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:2356:x1874203915618176:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380396.154206:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380396.154215:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 45 pid: 7761 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.154227:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 45 pid: 7761 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.154249:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ce expref: 45 pid: 7761 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.154265:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380396.154269:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.154279:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.154287:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.154314:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380396.154411:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+44:2356:x1874203915618176:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 244us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380396.154419:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 40 00010000:00010000:2.0:1787380396.154480:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.154489:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380396.154507:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787380396.154690:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842888 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 45 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.154704:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.154710:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:2.0:1787380396.154713:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787380396.154715:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3000, rc 0) 00000100:00100000:2.0:1787380396.154754:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+44:10376:x1874203915618048:12345-192.168.206.14@tcp:101:bash.0 Request processed in 5002us (5321us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787380396.154761:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:3.0:1787380396.160236:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.160314:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915618432 00000100:00100000:2.0:1787380396.160323:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915618432 00000100:00100000:2.0:1787380396.160449:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:2.0:1787380396.160459:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+44:10376:x1874203915618432:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:2.0:1787380396.160716:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.160733:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.160745:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380396.160813:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787380396.160836:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af4b4310 reply state 000000008d631470 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380396.160843:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380396.160934:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:10376:x1874203915618432:12345-192.168.206.14@tcp:36:bash.0 Request processed in 476us (706us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787380396.160941:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 58 00000020:00080000:2.0:1787380396.160946:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787380396.163376:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380396.163400:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380396.163408:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380396.163413:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380396.163418:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380396.163425:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380396.163441:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380396.163444:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380396.163448:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380396.163454:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d11884289d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380396.167401:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.167959:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915618560 00000100:00100000:1.0:1787380396.167970:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915618560 00000100:00100000:1.0:1787380396.168031:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:1.0:1787380396.168042:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+46:10376:x1874203915618560:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380396.168080:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380396.168101:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67e3 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.168178:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.168201:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.168210:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.168239:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.168252:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 47 pid: 5786 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380396.168265:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5120700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935572096:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380396.168359:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698854600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380396.173569:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5120700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935572096:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380396.173599:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380396.175093:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.175201:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915618688 00000100:00100000:2.0:1787380396.175209:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915618688 00010000:00010000:2.0:1787380396.175248:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 48 pid: 5786 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380396.175301:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:2.0:1787380396.175311:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:2355:x1874203915618688:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380396.175334:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380396.175372:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 48 pid: 5786 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.175385:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 48 pid: 5786 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.175413:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d11884288f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67dc expref: 48 pid: 5786 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.175430:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:2.0:1787380396.175435:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.175445:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.175454:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.175502:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380396.175652:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.175661:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380396.175717:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787380396.175722:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380396.175746:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.175777:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67e3 expref: 48 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.175790:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67e3 expref: 47 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.175797:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380396.175800:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380396.175803:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:2.0:1787380396.175849:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:2355:x1874203915618688:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 539us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380396.175857:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:1.0:1787380396.177354:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+46:10376:x1874203915618560:12345-192.168.206.14@tcp:101:bash.0 Request processed in 9287us (9938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380396.177366:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:1.0:1787380396.191128:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.191160:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915618944 00000100:00100000:1.0:1787380396.191169:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915618944 00000100:00100000:1.0:1787380396.191228:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:1.0:1787380396.191238:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+46:10376:x1874203915618944:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:1.0:1787380396.191484:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:10376:x1874203915618944:12345-192.168.206.14@tcp:35:bash.0 Request processed in 247us (363us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787380396.191492:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00000004:00080000:1.0:1787380396.280238:0:7760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346591897545ns, next at 347591895134ns, rc = 0 00000100:00100000:2.0:1787380396.280249:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935572224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380396.280356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380396.280437:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935572224 00000100:00100000:0.0:1787380396.280446:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935572224 00000100:00100000:0.0:1787380396.280514:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787380396.280531:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935572224:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787380396.280534:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787380396.280565:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380396.280734:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935572224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380396.280796:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935572224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 266us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380396.280804:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787380396.285361:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.285494:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915619200 00000100:00100000:1.0:1787380396.285505:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915619200 00000100:00100000:1.0:1787380396.285587:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:1.0:1787380396.285597:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:10386:x1874203915619200:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380396.285623:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380396.285649:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67ea expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380396.285755:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787380396.285865:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ea expref: 49 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.285880:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:1.0:1787380396.285883:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380396.285887:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ea expref: 49 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.285899:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f000, rc 0) 00000100:00100000:1.0:1787380396.285960:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:10386:x1874203915619200:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 364us (636us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787380396.285966:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:2.0:1787380396.296142:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.296321:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915619328 00000100:00100000:1.0:1787380396.296561:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915619328 00000100:00100000:1.0:1787380396.296708:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:1.0:1787380396.296719:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:10386:x1874203915619328:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:1.0:1787380396.296794:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296827:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296839:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296854:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296860:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296866:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296956:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296964:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.296971:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380396.297085:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297098:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297104:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297121:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297126:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380396.297130:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297137:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297148:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:1.0:1787380396.297151:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380396.297155:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297162:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d1188428c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297174:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297180:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297197:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297203:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380396.297205:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297223:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297233:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968911d700) 00010000:00010000:1.0:1787380396.297236:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380396.297239:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297244:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188428c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297259:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297266:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297271:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297276:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380396.297279:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297284:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297291:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380396.297293:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380396.297295:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.297310:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188428ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380396.297600:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5195180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:10386:x1874203915619328:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 882us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380396.297609:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:3.0:1787380396.300419:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.300729:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915619584 00000100:00100000:1.0:1787380396.300743:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915619584 00000100:00100000:1.0:1787380396.300798:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:1.0:1787380396.300808:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:10386:x1874203915619584:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380396.301245:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+49:10386:x1874203915619584:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 436us (833us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787380396.301253:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:0.0:1787380396.344456:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380396.344644:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915619840 00000100:00100000:3.0:1787380396.344654:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915619840 00000100:00100000:3.0:1787380396.344716:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:3.0:1787380396.344727:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+49:10389:x1874203915619840:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380396.344751:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380396.344770:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188428d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67f1 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.344832:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.344846:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.344856:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.344870:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.344877:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.344882:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345012:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188428ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345020:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188428ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345027:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188428ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380396.345036:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787380396.345121:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345129:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345135:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345139:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380396.345144:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345150:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345161:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380396.345164:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380396.345167:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345182:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b800/0x651a07d1188428dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345207:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345212:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345217:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345221:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380396.345224:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345229:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345236:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968727fa00) 00010000:00010000:3.0:1787380396.345238:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380396.345240:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345246:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b200/0x651a07d1188428e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345282:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b600/0x651a07d1188428d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67f1 expref: 52 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345293:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188428ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67f1 expref: 51 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.345306:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380396.345308:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380396.345310:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380396.345649:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:10389:x1874203915619840:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 923us (1202us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787380396.345657:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:2.0:1787380396.351061:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380396.351154:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915619968 00000100:00100000:0.0:1787380396.351163:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915619968 00000100:00100000:0.0:1787380396.351243:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:0.0:1787380396.351253:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:2355:x1874203915619968:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380396.351271:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380396.351300:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188428ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67f1 expref: 51 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380396.351319:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380396.351332:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380396.351434:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:2355:x1874203915619968:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 181us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380396.351442:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:1.0:1787380396.354533:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.354608:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915620096 00000100:00100000:2.0:1787380396.354617:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915620096 00000100:00100000:2.0:1787380396.354685:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:2.0:1787380396.354696:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:10389:x1874203915620096:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:2.0:1787380396.354761:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354778:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354789:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354822:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354830:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354849:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354855:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380396.354859:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354865:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354876:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:2.0:1787380396.354879:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380396.354883:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.354888:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380396.354964:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:10389:x1874203915620096:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 270us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380396.354972:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:2.0:1787380396.361887:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380396.362201:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915620352 00000100:00100000:0.0:1787380396.362213:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915620352 00000100:00100000:0.0:1787380396.362374:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:0.0:1787380396.362385:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:10389:x1874203915620352:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380396.363840:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:10389:x1874203915620352:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 1311us (1815us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787380396.363869:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:3.0:1787380396.514070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.514267:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915620608 00000100:00100000:2.0:1787380396.514278:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915620608 00000100:00100000:2.0:1787380396.514374:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:2.0:1787380396.514385:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:10407:x1874203915620608:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:2.0:1787380396.514567:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380396.514588:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67f8 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.515196:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842906 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.515213:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.515225:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380396.515240:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787380396.515428:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188428ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67f8 expref: 54 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.515446:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67f8 expref: 53 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.515454:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:2.0:1787380396.515456:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787380396.515459:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3c00, rc 0) 00000100:00100000:2.0:1787380396.515530:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10407:x1874203915620608:12345-192.168.206.14@tcp:101:cat.0 Request processed in 1147us (1469us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787380396.515538:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 64 00010000:00010000:2.0:1787380396.537492:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380396.558628:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380396.558848:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915620736 00000100:00100000:2.0:1787380396.558856:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915620736 00000100:00100000:2.0:1787380396.558920:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:2.0:1787380396.558930:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10408:x1874203915620736:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380396.558972:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380396.558992:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f67ff expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.559054:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d11884291b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.559068:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d11884291b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.559079:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d11884291b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380396.559139:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787380396.559143:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380396.559164:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d11884291b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.559201:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ff expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.559220:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d11884291b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ff expref: 54 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.559230:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380396.559232:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380396.559236:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2c00, rc 0) 00000100:00100000:2.0:1787380396.559304:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10408:x1874203915620736:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 375us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380396.559312:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:0.0:1787380396.567133:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.567299:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915621120 00000100:00100000:1.0:1787380396.567309:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915621120 00000100:00100000:1.0:1787380396.567387:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:1.0:1787380396.567398:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10408:x1874203915621120:12345-192.168.206.14@tcp:35:lfs.0 00000001:00080000:1.0:1787380396.567791:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967350 00000100:00100000:1.0:1787380396.567917:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10408:x1874203915621120:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 519us (795us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1787380396.567926:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000020:00080000:1.0:1787380396.567931:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787380396.570427:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.570512:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915621248 00000100:00100000:1.0:1787380396.570521:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915621248 00000100:00100000:1.0:1787380396.570602:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:1.0:1787380396.570612:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10408:x1874203915621248:12345-192.168.206.14@tcp:103:lfs.0 00010000:00010000:1.0:1787380396.570645:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787380396.570669:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188428ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67e3 expref: 56 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.570690:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67f8 expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.570714:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d1188427b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67a4 expref: 54 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.570725:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380396.570737:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380396.570793:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10408:x1874203915621248:12345-192.168.206.14@tcp:103:lfs.0 Request processed in 182us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380396.570801:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:3.0:1787380396.575140:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380396.575296:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915621376 00000100:00100000:1.0:1787380396.575306:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915621376 00000100:00100000:1.0:1787380396.575392:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:1.0:1787380396.575402:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10408:x1874203915621376:12345-192.168.206.14@tcp:58:lfs.0 00010000:00010000:1.0:1787380396.575533:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.575551:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380396.575565:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380396.575885:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380396.576374:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787380396.576443:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787380396.576617:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10408:x1874203915621376:12345-192.168.206.14@tcp:58:lfs.0 Request processed in 1214us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380396.576627:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:0.0:1787380396.604612:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380396.604741:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915621504 00000100:00100000:3.0:1787380396.604750:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915621504 00000100:00100000:3.0:1787380396.604821:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:3.0:1787380396.604830:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10410:x1874203915621504:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380396.604851:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380396.604871:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6806 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.604931:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.604944:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.604963:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.604979:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605004:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605011:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605104:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605112:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605119:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380396.605152:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787380396.605156:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380396.605172:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605192:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605201:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605208:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605214:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605229:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380396.605233:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605241:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605254:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380396.605257:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380396.605261:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605267:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605289:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605295:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605301:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605305:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ce00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380396.605308:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605313:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.605333:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968727fa00) 00010000:00010000:3.0:1787380396.605384:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380396.606031:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.606042:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.606085:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 55 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.606176:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 54 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380396.606195:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968911d700) 00010000:00010000:3.0:1787380396.606198:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380396.606201:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216de00, rc 0) 00000100:00100000:3.0:1787380396.606556:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10410:x1874203915621504:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1448us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380396.608519:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 67 00000001:00080000:3.0:1787380396.880277:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:3.0:1787380396.880322:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:3.0:1787380396.880333:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1787380396.880426:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787380396.880436:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d96aaf9eb40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787380396.880441:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9687c5af00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d96aaf9e840 00000020:00080000:3.0:1787380396.880445:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9687c5ae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d96b51f7c00 00000020:00080000:3.0:1787380396.880477:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787380396.880595:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787380396.880787:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380396.880807:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935572352:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787380396.880889:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380396.880946:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935572352 00000100:00100000:2.0:1787380396.880952:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935572352 00000100:00100000:2.0:1787380396.881012:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380396.881021:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935572352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787380396.881046:0:6577:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787380396.881078:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8942aa, atime: 0x6a8942aa, ctime: 0x6a8942aa, blocks: 0x1 00010000:00010000:2.0:1787380396.881085:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881101:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1787380396.881105:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380396.881111:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881125:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881136:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881144:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881158:0:6577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787380396.881631:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3299:x1874203935572352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 609us (740us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787380396.881639:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787380396.881665:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380396.881671:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881680:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3200 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380396.881685:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881695:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881714:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881721:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b61c16b/0x651a07d118842945 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380396.881740:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380396.881742:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380396.881744:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787380396.881775:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b5159500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787380396.881781:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935572352:0@lo:6:osp-syn-1-0.0 00000040:00080000:2.0:1787380397.175735:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380397.175745:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380397.175810:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787380397.175817:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787380397.175931:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935572480:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380397.176092:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f0d0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787380397.184069:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.184148:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915621632 00000100:00100000:3.0:1787380397.184154:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915621632 00000100:00100000:1.0:1787380397.184158:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935572480:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787380397.184214:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:3.0:1787380397.184223:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10421:x1874203915621632:12345-192.168.206.14@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787380397.184302:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10421:x1874203915621632:12345-192.168.206.14@tcp:900:lhsmtool_posix.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.184309:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:0.0:1787380397.187136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380397.187210:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915621760 00000100:00100000:2.0:1787380397.187219:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915621760 00000100:00100000:2.0:1787380397.187278:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:2.0:1787380397.187288:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10421:x1874203915621760:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787380397.187322:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787380397.187480:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10421:x1874203915621760:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 192us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380397.187488:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:3.0:1787380397.196673:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380397.196738:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915621888 00000100:00100000:2.0:1787380397.196748:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915621888 00000100:00100000:2.0:1787380397.196809:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:2.0:1787380397.196819:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10421:x1874203915621888:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787380397.196888:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.196904:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.196918:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.196932:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.196939:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.196960:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.196986:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.196995:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197002:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380397.197039:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787380397.197044:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380397.197058:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197068:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197074:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197080:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197086:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380397.197090:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197098:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197126:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:2.0:1787380397.197129:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380397.197134:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197141:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d11884294c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197154:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197160:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197166:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197170:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380397.197173:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197178:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197199:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9d969371af00) 00010000:00010000:2.0:1787380397.197202:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380397.197204:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197209:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842953 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197234:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197240:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197246:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197255:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380397.197258:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197264:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197271:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968911d700) 00010000:00010000:2.0:1787380397.197273:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380397.197275:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.197280:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884295a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380397.197996:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10421:x1874203915621888:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 Request processed in 1172us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380397.198006:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:0.0:1787380397.200735:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380397.201070:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915622144 00000100:00100000:2.0:1787380397.201080:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915622144 00000100:00100000:2.0:1787380397.201145:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:2.0:1787380397.201168:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10421:x1874203915622144:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380397.201197:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380397.201217:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842961 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f680d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.201314:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.201327:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.201361:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380397.201375:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787380397.202692:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202706:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202713:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202719:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380397.202723:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202730:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202747:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968911d700) 00010000:00010000:3.0:1787380397.202750:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380397.202754:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202772:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202821:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842961 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f680d expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202832:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:3.0:1787380397.202834:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380397.202838:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842961 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f680d expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.202847:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2200, rc 0) 00000100:00100000:3.0:1787380397.203068:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915622144:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1899us (2341us total) trans 4294967352 rc 301/301 00000100:00100000:3.0:1787380397.203076:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:0.0:1787380397.208005:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.208103:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915622272 00000100:00100000:3.0:1787380397.208114:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915622272 00000100:00100000:3.0:1787380397.208192:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:3.0:1787380397.208203:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915622272:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380397.208244:0:7761:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380397.212397:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915622272:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 4180us (4385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.212414:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:1.0:1787380397.223600:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.223822:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915622528 00000100:00100000:3.0:1787380397.223832:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915622528 00000100:00100000:3.0:1787380397.223898:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00100000:3.0:1787380397.223915:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915622528:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380397.223935:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380397.223938:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787380397.223963:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d11884291b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f67ff expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.223980:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380397.223985:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380397.223998:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842976 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6814 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380397.224924:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787380397.225174:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d11884297d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.225198:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d11884297d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.225208:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d11884297d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.225261:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842976 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6814 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.225277:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d11884297d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6814 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.225285:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380397.225288:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380397.225297:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ce00, rc 0) 00000100:00100000:3.0:1787380397.225397:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10421:x1874203915622528:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1483us (1805us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787380397.225406:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00100000:2.0:1787380397.234562:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.234722:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915622784 00000100:00100000:3.0:1787380397.234731:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915622784 00000100:00100000:3.0:1787380397.234777:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 73 00000100:00100000:3.0:1787380397.234785:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10421:x1874203915622784:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380397.234834:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380397.234858:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d11884297d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6814 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.234878:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380397.234888:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380397.234909:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.234921:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.234930:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.234985:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.234992:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.234999:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235238:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235245:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235251:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235257:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380397.235261:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235268:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235277:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380397.235280:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380397.235283:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235288:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d11884298b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235297:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235302:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235307:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235317:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380397.235320:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235326:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235334:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x26f9ae09 (ffff9d968727f700) 00010000:00010000:3.0:1787380397.235358:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380397.235361:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.235366:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842992 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x26f9ae09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380397.244709:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915622784:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 9913us (10145us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380397.244724:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 73 00000100:00100000:1.0:1787380397.263948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.264039:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915622912 00000100:00100000:3.0:1787380397.264048:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915622912 00000100:00100000:3.0:1787380397.264108:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 74 00000100:00100000:3.0:1787380397.264118:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915622912:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380397.264142:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380397.264163:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842999 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f681b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.264207:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.264220:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.264240:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.264324:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.264371:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.264381:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:3.0:1787380397.264515:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380397.264518:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c000, rc 0) 00000100:00100000:3.0:1787380397.264572:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10421:x1874203915622912:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 456us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.264579:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 74 00000100:00100000:1.0:1787380397.270576:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.271898:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915623168 00000100:00100000:3.0:1787380397.271910:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915623168 00000100:00100000:3.0:1787380397.271986:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 75 00000100:00100000:3.0:1787380397.271997:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10421:x1874203915623168:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380397.272076:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.272092:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.272104:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380397.272476:0:7761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787380397.272487:0:7761:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347584147612ns, next at 348584145390ns, rc = 0 00000004:00010000:3.0:1787380397.272823:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5180029 reply state 000000003ad914e0 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.272834:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380397.272944:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10421:x1874203915623168:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 941us (2378us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787380397.272953:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 75 00010000:00010000:2.0:1787380397.276440:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.276453:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.276460:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.276466:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380397.276470:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.276482:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.276499:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:2.0:1787380397.276502:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787380397.276507:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.276513:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188429a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380397.290900:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380397.290974:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915623296 00000100:00100000:0.0:1787380397.290983:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915623296 00000100:00100000:0.0:1787380397.291045:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:0.0:1787380397.291056:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10421:x1874203915623296:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380397.291080:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380397.291100:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6822 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.291156:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.291171:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.291200:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:0.0:1787380397.291204:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380397.291207:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e400, rc 0) 00000100:00100000:0.0:1787380397.291265:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10421:x1874203915623296:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 211us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.291283:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:2.0:1787380397.298119:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380397.298222:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915623424 00000100:00100000:0.0:1787380397.298232:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915623424 00000100:00100000:0.0:1787380397.298280:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:0.0:1787380397.298288:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874203915623424:12345-192.168.206.14@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787380397.298320:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:0.0:1787380397.298366:0:6576:0:(genops.c:1406:class_connect()) connect: client 7dca2b77-2f7d-460b-a508-1b61c3cf2401, cookie 0x651a07d1188429b5 00002000:00100000:0.0:1787380397.298378:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7dca2b77-2f7d-460b-a508-1b61c3cf2401/ffff9d9687394000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787380397.298400:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787380397.298643:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787380397.298676:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9d9687397800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380397.298756:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2352:x1874203915623424:12345-192.168.206.14@tcp:8:lhsmtool_posix.0 Request processed in 467us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.298764:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:2.0:1787380397.304601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.304691:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915623552 00000100:00100000:3.0:1787380397.304702:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915623552 00000100:00100000:3.0:1787380397.304773:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:3.0:1787380397.304784:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:0:x1874203915623552:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787380397.305053:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380397.316175:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935572608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380397.316277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380397.316950:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935572608 00000100:00100000:0.0:1787380397.316961:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935572608 00000100:00100000:0.0:1787380397.317020:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787380397.317031:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935572608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380397.317061:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380397.319843:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935572608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2803us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.319856:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787380397.319887:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380397.321840:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935572608:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787380397.391526:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000001:00080000:2.0:1787380397.391546:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1787380397.391868:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:0:x1874203915623552:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 87082us (87273us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787380397.391880:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:3.0:1787380397.396654:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380397.397984:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915623808 00000100:00100000:0.0:1787380397.397994:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915623808 00000100:00100000:0.0:1787380397.398139:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:0.0:1787380397.398149:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10421:x1874203915623808:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787380397.398419:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:10421:x1874203915623808:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 272us (1771us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787380397.398427:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1787380397.402823:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.402863:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915624064 00000100:00100000:3.0:1787380397.402872:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915624064 00000100:00100000:3.0:1787380397.402930:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 77 00000100:00100000:3.0:1787380397.402940:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:10421:x1874203915624064:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787380397.403044:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:10421:x1874203915624064:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.403062:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 77 00000100:00100000:2.0:1787380397.408921:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.408988:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915624192 00000100:00100000:3.0:1787380397.408997:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915624192 00000100:00100000:3.0:1787380397.409056:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:3.0:1787380397.409065:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:10421:x1874203915624192:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380397.409083:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380397.409103:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6829 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.409170:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188429c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.409192:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188429c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.409204:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188429c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380397.409240:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380397.409259:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188429c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.409535:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6829 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.409556:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188429c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6829 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.409565:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:3.0:1787380397.409577:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787380397.409581:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c800, rc 0) 00000100:00100000:3.0:1787380397.409680:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10421:x1874203915624192:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 615us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.409687:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:3.0:1787380397.425557:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.425599:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.426133:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.426222:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.426250:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915624704 00000100:00100000:3.0:1787380397.426258:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915624704 00000100:00100000:3.0:1787380397.426320:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 134 00000100:00100000:3.0:1787380397.426330:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915624704:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380397.426433:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95d22c36-51bc-485d-88b7-d90632ec1801+5:2356:x1874203915624704:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 104us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.426442:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 134 00000100:00100000:0.0:1787380397.426696:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915624320 00000100:00100000:0.0:1787380397.426702:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915624320 00000100:00100000:0.0:1787380397.426731:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915624576 00000100:00100000:0.0:1787380397.426734:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915624576 00000100:00100000:0.0:1787380397.426762:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:0.0:1787380397.426769:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915624576:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380397.426802:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915624576:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 33us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.426809:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:0.0:1787380397.426826:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:0.0:1787380397.426835:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915624320:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380397.426847:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380397.426866:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6830 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380397.426892:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8942ad, blocks: 0x1 00010000:00010000:0.0:1787380397.426907:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1787380397.426912:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380397.426922:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.426965:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.426977:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1ee00, rc 0) 00000100:00100000:0.0:1787380397.426999:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915624320:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 167us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.427006:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00080000:0.0:1787380397.427028:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380397.427033:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380397.432801:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915624448 00000100:00100000:2.0:1787380397.432817:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915624448 00000100:00100000:2.0:1787380397.432894:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 286 00000100:00100000:2.0:1787380397.432908:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915624448:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380397.433006:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915624448:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 101us (6872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380397.433015:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 286 00000100:00100000:2.0:1787380397.440873:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380397.440910:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915624960 00000100:00100000:2.0:1787380397.440925:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915624960 00000100:00100000:2.0:1787380397.440994:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:2.0:1787380397.441004:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10421:x1874203915624960:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787380397.441098:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10421:x1874203915624960:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380397.441106:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:2.0:1787380397.448096:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380397.448175:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915625088 00000100:00100000:0.0:1787380397.448194:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915625088 00000100:00100000:0.0:1787380397.448242:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:0.0:1787380397.448251:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:10421:x1874203915625088:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380397.448268:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380397.448294:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6837 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.448324:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.448332:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380397.448363:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380397.448370:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.448426:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.448439:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 7 pid: 8465 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.448452:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1874203935572736:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380397.448530:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 11 seconds 00000040:00080000:1.0:1787380397.453865:0:11848:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380397.453874:0:11848:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380397.453906:0:11848:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787380397.453911:0:11848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380397.455877:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5a9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1874203935572736:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380397.455909:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.455931:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f600, rc 0) 00000100:00100000:0.0:1787380397.456052:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:10421:x1874203915625088:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 7801us (7963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.456062:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:0.0:1787380397.459132:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.459571:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915625216 00000100:00100000:3.0:1787380397.459580:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915625216 00010000:00010000:3.0:1787380397.460482:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 7 pid: 8465 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.460647:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:3.0:1787380397.460668:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915625216:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380397.460687:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380397.460710:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 7 pid: 8465 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.460737:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 7 pid: 8465 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.460761:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188429ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6830 expref: 7 pid: 8465 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.460775:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380397.460779:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380397.460786:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 6 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.460795:0:11008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 6 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.460831:0:11008:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 6 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.460846:0:11008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11008:1874203935572864:192.168.206.14@tcp:105: 00000100:00100000:3.0:1787380397.460932:0:11008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d42600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380397.467162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380397.467853:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915625344 00000100:00100000:0.0:1787380397.467862:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915625344 00002000:00100000:0.0:1787380397.467906:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d95877cc380 x1874203915625344/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:203/0 lens 504/0 e 0 to 0 dl 1787380408 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380397.467922:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d95877cc380 with x1874203915625344 ext(0->8) 00002000:00010000:0.0:1787380397.467932:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d95877cc380 00000100:00100000:1.0:1787380397.467942:0:11008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11008:1874203935572864:192.168.206.14@tcp:105: 00010000:00010000:1.0:1787380397.467967:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380397.467967:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:0.0:1787380397.467991:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915625344:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787380397.468031:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915625216:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 7374us (8909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.468040:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:0.0:1787380397.468799:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915625344:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 Request processed in 819us (1643us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787380397.468807:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00002000:00100000:0.0:1787380397.468815:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d95877cc380 x1874203915625344/t4294967302(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:203/0 lens 504/448 e 0 to 0 dl 1787380408 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380397.468824:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d95877cc380 with x1874203915625344 ext(0->8) 00002000:00010000:0.0:1787380397.468828:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d95877cc380 00000100:00100000:0.0:1787380397.488866:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380397.488902:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915625472 00000100:00100000:0.0:1787380397.488911:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915625472 00000100:00100000:0.0:1787380397.488967:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:0.0:1787380397.488978:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10421:x1874203915625472:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787380397.546162:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10421:x1874203915625472:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 Request processed in 57177us (57297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.546175:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 80 00000001:00080000:0.0:1787380397.546221:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1787380397.546236:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787380397.546252:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787380397.546872:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1787380397.546884:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787380397.546892:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380397.546908:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935572992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787380397.546958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380397.547026:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935572992 00000100:00100000:0.0:1787380397.547033:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935572992 00000100:00100000:0.0:1787380397.547072:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380397.547080:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935572992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787380397.547242:0:6578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787380397.547246:0:6578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787380397 00002000:00010000:0.0:1787380397.547248:0:6578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787380397.547251:0:6578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787380397 -> 1787380397 00002000:00010000:0.0:1787380397.547253:0:6578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787380397.547288:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935572992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (329us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787380397.547296:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787380397.547359:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d9698d90700/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787380397.547365:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935572992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787380397.558464:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380397.558539:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915625600 00000100:00100000:1.0:1787380397.558548:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915625600 00000100:00100000:1.0:1787380397.558596:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:1.0:1787380397.558604:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915625600:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787380397.564645:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787380397.629947:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1787380397.629964:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787380397.630942:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915625600:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 Request processed in 72330us (72477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.630955:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:0.0:1787380397.644628:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380397.644810:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915625856 00000100:00100000:2.0:1787380397.644820:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915625856 00000100:00100000:2.0:1787380397.644877:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 81 00000100:00100000:2.0:1787380397.644885:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10421:x1874203915625856:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787380397.644937:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380397.644962:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188429c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6829 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.644981:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:2.0:1787380397.644986:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380397.645012:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.645024:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.645033:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380397.645287:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027496d2a reply state 0000000062e6f83d transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380397.645296:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380397.645408:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10421:x1874203915625856:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 523us (788us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787380397.645416:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 81 00000100:00100000:2.0:1787380397.665371:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380397.665425:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915625984 00000100:00100000:2.0:1787380397.665433:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915625984 00000100:00100000:2.0:1787380397.665753:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:2.0:1787380397.665763:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915625984:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787380397.665999:0:6578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787380397.666003:0:6578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787380397 -> 1787380396 00002000:00010000:2.0:1787380397.666006:0:6578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787380394 00002000:00010000:2.0:1787380397.666008:0:6578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787380397 -> 1787380396 00002000:00010000:2.0:1787380397.666010:0:6578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787380397.666064:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915625984:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 302us (733us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787380397.666072:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 31 00010000:00010000:1.0:1787380397.666432:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.666465:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.666473:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.666480:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380397.666484:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.666492:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.666508:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:1.0:1787380397.666511:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380397.666516:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.666522:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188429d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.675242:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.675312:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915626240 00000100:00100000:3.0:1787380397.675322:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915626240 00000100:00100000:3.0:1787380397.675414:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:3.0:1787380397.675424:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10421:x1874203915626240:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787380397.675501:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.675519:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.675528:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.675560:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.675573:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 13 pid: 5788 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.675587:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935573120:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380397.675852:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380397.677717:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935573120:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380397.677744:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.678274:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.678365:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915626368 00000100:00100000:3.0:1787380397.678372:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915626368 00010000:00010000:3.0:1787380397.678411:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 14 pid: 5788 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.678443:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:3.0:1787380397.678452:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:2355:x1874203915626368:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380397.678465:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380397.678471:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 14 pid: 5788 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.678495:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 14 pid: 5788 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.678516:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d1188429a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f681b expref: 14 pid: 5788 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.678532:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:3.0:1787380397.678536:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.678546:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.678553:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.678573:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380397.678677:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678685:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678719:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678726:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678732:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678738:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ce00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380397.678742:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678749:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678758:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:0.0:1787380397.678761:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787380397.678764:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.678770:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188429df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.680256:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2355:x1874203915626368:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 1798us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.680270:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:0.0:1787380397.680418:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915626240:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 Request processed in 4995us (5182us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787380397.680427:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:3.0:1787380397.683931:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380397.683989:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915626496 00000100:00100000:0.0:1787380397.683998:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915626496 00000100:00100000:0.0:1787380397.684055:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:0.0:1787380397.684080:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915626496:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787380397.684122:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.684141:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.684149:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380397.684154:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380397.684159:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.684205:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.684219:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 7 pid: 8465 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.684234:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1874203935573248:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380397.684443:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380397.687625:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380397.687801:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915626624 00000100:00100000:2.0:1787380397.687810:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915626624 00010000:00010000:2.0:1787380397.687849:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 8 pid: 8465 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380397.687890:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:2.0:1787380397.687918:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915626624:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380397.687934:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380397.687959:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 8 pid: 8465 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.687973:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 8 pid: 8465 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.688000:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380397.688005:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380397.688010:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.688020:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.688041:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380397.688087:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915626624:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 171us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380397.688095:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 44 00010000:00010000:0.0:1787380397.688796:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d1188429d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6837 expref: 7 pid: 8465 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.688814:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1874203935573248:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380397.688835:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688855:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688862:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688890:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688899:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688906:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688913:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380397.688918:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688926:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688939:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.688957:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d658cd7/0x651a07d1188429e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.689010:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915626496:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 Request processed in 4933us (5087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.689019:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:2.0:1787380397.694508:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380397.695162:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915626880 00000100:00100000:1.0:1787380397.695172:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915626880 00000100:00100000:0.0:1787380397.695380:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 83 00000100:00100000:0.0:1787380397.695400:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:10421:x1874203915626880:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787380397.695477:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.695494:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.695506:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.695925:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.695937:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.695945:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.695976:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.696003:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 13 pid: 5787 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.696018:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935573376:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380397.696096:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380397.699083:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380397.699114:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915627008 00000100:00100000:3.0:1787380397.699122:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915627008 00010000:00010000:3.0:1787380397.699161:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 14 pid: 5787 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.699226:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:3.0:1787380397.699235:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:2356:x1874203915627008:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380397.699250:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380397.699257:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 14 pid: 5787 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.699269:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 14 pid: 5787 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.699291:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:3.0:1787380397.699296:0:11008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.699305:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.699312:0:11008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.699330:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380397.699395:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:2356:x1874203915627008:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 161us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.699402:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00010000:00010000:1.0:1787380397.700749:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d1188429ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6822 expref: 13 pid: 5787 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380397.700767:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd267480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935573376:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380397.700787:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.700869:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.700876:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380397.701077:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787380397.701649:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1787380397.701804:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787380397.701875:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1874203935573504:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787380397.701986:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380397.702043:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380397.702135:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935573504 00000100:00100000:1.0:1787380397.702141:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935573504 00000100:00100000:1.0:1787380397.702234:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380397.702242:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1874203935573504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380397.702321:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5788:x1874203935573504:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.702328:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380397.702426:0:5788:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787380397.702432:0:5788:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d9698d90700, transno 4294967303 00000100:00100000:0.0:1787380397.702449:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1874203935573504:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787380397.704003:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1787380397.704085:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1874203935573632:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787380397.704138:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380397.704651:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698de3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380397.704808:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935573632 00000100:00100000:2.0:1787380397.704816:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935573632 00000100:00100000:2.0:1787380397.704856:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380397.704864:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5788:x1874203935573632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787380397.705148:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5788:x1874203935573632:12345-0@lo:1000:mdt00_002.0 Request processed in 284us (1008us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787380397.705169:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380397.705281:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5788:1874203935573632:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787380397.705317:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705333:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705477:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705484:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380397.705488:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705496:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705512:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d968727f700) 00010000:00010000:0.0:1787380397.705515:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380397.705520:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705526:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d1188429f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705566:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705571:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705578:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705583:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380397.705593:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705599:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705608:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968911d700) 00010000:00010000:0.0:1787380397.705610:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380397.705613:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705746:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842922 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705794:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705808:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 16 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705816:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705845:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 16 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380397.705860:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 16 pid: 7761 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380397.705873:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935573760:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380397.706089:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698de3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380397.710075:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380397.710135:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915627136 00000100:00100000:1.0:1787380397.710144:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915627136 00010000:00010000:1.0:1787380397.710188:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 17 pid: 7761 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380397.710224:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:1.0:1787380397.710233:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:2356:x1874203915627136:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380397.710248:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380397.710254:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 17 pid: 7761 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.710267:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 17 pid: 7761 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.710291:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968911d700) 00010000:00010000:1.0:1787380397.710296:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.710305:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.710327:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380397.710376:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380397.710491:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884293e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6806 expref: 17 pid: 7761 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380397.710509:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935573760:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380397.710533:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710541:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710547:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710559:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710565:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710580:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710586:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380397.710590:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710596:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710605:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968911d700) 00010000:00010000:3.0:1787380397.710607:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380397.710611:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710626:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d1188429fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710647:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710652:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710666:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710672:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380397.710674:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710680:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710688:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968911d700) 00010000:00010000:3.0:1787380397.710690:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380397.710693:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.710698:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d1188429ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380397.710984:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380397.710989:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380397.711015:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787380397.711020:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380397.712240:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:2356:x1874203915627136:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 1999us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.712253:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:3.0:1787380397.712360:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10421:x1874203915626880:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 16962us (17861us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1787380397.712395:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 83 00000020:00080000:3.0:1787380397.712400:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1787380397.718249:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380397.718991:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915627392 00000100:00100000:1.0:1787380397.719001:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915627392 00000100:00100000:2.0:1787380397.719170:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:2.0:1787380397.719191:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10421:x1874203915627392:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787380397.720132:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787380397.720247:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:2.0:1787380397.720292:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.720306:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.720317:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.720325:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.720332:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.720366:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380397.720398:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787380397.720500:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10421:x1874203915627392:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 1318us (2260us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787380397.720509:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00000020:00080000:2.0:1787380397.720520:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787380397.720580:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380397.720586:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.720593:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2c00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380397.720597:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.720605:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.720625:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d969371a200) 00010000:00010000:3.0:1787380397.720628:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787380397.720632:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.720638:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380397.720653:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380397.720655:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380397.720663:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380398.584135:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380399.542091:0:11900:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380399.542105:0:11900:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380399.543224:0:11900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787380399.543237:0:11900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787380399.609647:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380399.740882:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380399.740928:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915627648 00000100:00100000:2.0:1787380399.740938:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915627648 00000100:00100000:2.0:1787380399.741012:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 84 00000100:00100000:2.0:1787380399.741036:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:10440:x1874203915627648:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380399.741066:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380399.741239:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f683e expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.741741:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842a10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.741759:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842a10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.741774:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842a10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380399.741789:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787380399.741988:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f683e expref: 20 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.742005:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842a10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f683e expref: 19 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.742013:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380399.742015:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787380399.742037:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2200, rc 0) 00000100:00100000:2.0:1787380399.742129:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:10440:x1874203915627648:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1107us (1260us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787380399.742138:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 84 00000100:00080000:2.0:1787380399.742184:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380399.751704:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380399.752680:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915627776 00000100:00100000:2.0:1787380399.752694:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915627776 00000100:00100000:2.0:1787380399.752770:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:2.0:1787380399.752782:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:10440:x1874203915627776:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:2.0:1787380399.752877:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.752898:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.752912:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.752929:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.752936:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.752943:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753732:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753745:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753760:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380399.753817:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753832:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753839:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753846:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753851:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3a00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380399.753855:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753863:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753877:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380399.753880:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380399.753885:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753892:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842a1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753905:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753917:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753923:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753927:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380399.753931:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753936:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753944:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d969371af00) 00010000:00010000:2.0:1787380399.753947:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380399.753950:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753955:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753970:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753976:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753982:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.753987:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380399.753996:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.754002:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.754010:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d969371a000) 00010000:00010000:2.0:1787380399.754013:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380399.754016:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.754257:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842a2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380399.754390:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:10440:x1874203915627776:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 1605us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380399.754403:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:2.0:1787380399.814663:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380399.814786:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915628032 00000100:00100000:0.0:1787380399.814799:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915628032 00000100:00100000:0.0:1787380399.814878:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 86 00000100:00100000:0.0:1787380399.814891:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:10443:x1874203915628032:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380399.814920:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380399.814947:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842a33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6845 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.815052:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.815070:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.815084:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.815101:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.815108:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.815115:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.815979:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816007:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816016:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380399.816028:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787380399.816147:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816154:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816162:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816179:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380399.816185:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816193:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816207:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380399.816210:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380399.816215:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816222:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842a3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816236:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816249:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816254:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816259:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380399.816263:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816268:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816276:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d96991e8a00) 00010000:00010000:3.0:1787380399.816279:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380399.816281:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816287:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816500:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842a33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 22 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816519:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 21 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.816527:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380399.816529:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380399.816543:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216de00, rc 0) 00000100:00100000:3.0:1787380399.817282:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10443:x1874203915628032:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 2386us (2625us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787380399.817297:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 86 00000100:00100000:0.0:1787380399.821753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380399.821942:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915628160 00000100:00100000:3.0:1787380399.821955:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915628160 00000100:00100000:3.0:1787380399.822036:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 87 00000100:00100000:3.0:1787380399.822047:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10443:x1874203915628160:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:3.0:1787380399.822136:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822156:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822181:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822214:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822221:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822229:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822236:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380399.822241:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822250:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822283:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380399.822286:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380399.822290:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.822297:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380399.822594:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10443:x1874203915628160:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 546us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380399.822615:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 87 00000100:00100000:1.0:1787380399.826229:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380399.826333:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915628416 00000100:00100000:0.0:1787380399.826380:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915628416 00000100:00100000:0.0:1787380399.826453:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:0.0:1787380399.826465:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e1b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10443:x1874203915628416:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380399.826787:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e1b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:10443:x1874203915628416:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 323us (569us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787380399.826797:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:2.0:1787380399.865363:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380399.866874:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915628672 00000100:00100000:3.0:1787380399.866894:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915628672 00000100:00100000:3.0:1787380399.866970:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 88 00000100:00100000:3.0:1787380399.866982:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:9965:x1874203915628672:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380399.867016:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380399.867041:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f684c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.867187:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.867204:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 23 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.867214:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.867254:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 23 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.867277:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 23 pid: 7761 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380399.867292:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935573888:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380399.867422:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380399.873528:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380399.873828:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915628800 00000100:00100000:2.0:1787380399.873840:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915628800 00010000:00010000:2.0:1787380399.873896:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 24 pid: 7761 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380399.873948:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:2.0:1787380399.873961:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:2355:x1874203915628800:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380399.873981:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380399.873990:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 24 pid: 7761 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.874025:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 24 pid: 7761 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.874055:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:2.0:1787380399.874060:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.874071:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.874079:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.874102:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380399.874176:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:2355:x1874203915628800:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 207us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380399.874186:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 47 00010000:00010000:3.0:1787380399.875442:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6845 expref: 23 pid: 7761 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380399.875472:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935573888:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380399.875502:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.875513:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.875520:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380399.875543:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787380399.875976:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 24 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.875997:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 23 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380399.876008:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380399.876025:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380399.876029:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d000, rc 0) 00000100:00100000:3.0:1787380399.876102:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:9965:x1874203915628672:12345-192.168.206.14@tcp:101:bash.0 Request processed in 9121us (10772us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787380399.876112:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 88 00000100:00100000:1.0:1787380399.880022:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380399.880264:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915629056 00000100:00100000:3.0:1787380399.880277:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915629056 00000100:00100000:2.0:1787380399.880467:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 89 00000100:00100000:2.0:1787380399.880483:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:9965:x1874203915629056:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:2.0:1787380399.880839:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.880860:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380399.880875:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380399.880930:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:2.0:1787380399.880975:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a24aa2e1 reply state 000000001526b4e5 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380399.880985:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787380399.881034:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:2.0:1787380399.881147:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:9965:x1874203915629056:12345-192.168.206.14@tcp:36:bash.0 Request processed in 668us (1137us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787380399.881156:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 89 00000020:00080000:2.0:1787380399.881162:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787380399.884189:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.884211:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.884220:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.884226:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380399.884232:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.884240:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.884259:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:1.0:1787380399.884279:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380399.884285:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.884292:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842a72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380399.884481:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380399.888143:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915629184 00000100:00100000:1.0:1787380399.888159:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915629184 00000100:00100000:1.0:1787380399.888625:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 90 00000100:00100000:1.0:1787380399.888638:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:9965:x1874203915629184:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380399.888671:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380399.888695:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842a79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6853 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.888769:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842a79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6853 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.888787:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842a79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6853 expref: 27 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380399.888810:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:1.0:1787380399.888814:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380399.888818:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f800, rc 0) 00000100:00100000:1.0:1787380399.888895:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:9965:x1874203915629184:12345-192.168.206.14@tcp:101:bash.0 Request processed in 259us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380399.888904:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 90 00000100:00100000:1.0:1787380399.896677:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380399.896836:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915629312 00000100:00100000:0.0:1787380399.896849:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915629312 00000100:00100000:0.0:1787380399.896933:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:0.0:1787380399.896945:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:9965:x1874203915629312:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:0.0:1787380399.896969:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380399.896994:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f685a expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380399.897025:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8942ac, atime: 0x6a8942aa, ctime: 0x6a8942ac, blocks: 0xb 00010000:00010000:0.0:1787380399.897051:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1787380399.897056:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380399.897065:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.897086:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380399.897100:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1fe00, rc 0) 00000100:00100000:0.0:1787380399.897182:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd19b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:9965:x1874203915629312:12345-192.168.206.14@tcp:101:bash.0 Request processed in 240us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380399.897189:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00080000:3.0:1787380399.897717:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380399.901157:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380399.901406:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915629440 00000100:00100000:0.0:1787380399.901425:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915629440 00002000:00010000:0.0:1787380399.901475:0:6582:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787380399.901481:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bd0a0000 with x1874203915629440 ext(0->18446744073709551615) 00002000:00010000:0.0:1787380399.901495:0:6582:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96bd0a0000. 00000100:00100000:0.0:1787380399.901908:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:0.0:1787380399.901920:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915629440:12345-192.168.206.14@tcp:10:bash.0 00002000:00010000:0.0:1787380399.902248:0:6582:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787380399.902252:0:6582:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787380396 -> 1787380399 00002000:00010000:0.0:1787380399.902255:0:6582:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787380394 -> 1787380394 00002000:00010000:0.0:1787380399.902258:0:6582:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787380396 -> 1787380399 00002000:00010000:0.0:1787380399.902260:0:6582:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787380399.902378:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915629440:12345-192.168.206.14@tcp:10:bash.0 Request processed in 454us (1228us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787380399.902386:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00002000:00010000:0.0:1787380399.902391:0:6582:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787380399.902393:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bd0a0000 with x1874203915629440 ext(0->18446744073709551615) 00002000:00010000:0.0:1787380399.902399:0:6582:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96bd0a0000. 00000001:00080000:0.0:1787380399.941211:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1787380399.941239:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787380400.003980:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.004591:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915629568 00000100:00100000:3.0:1787380400.004614:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915629568 00000100:00100000:3.0:1787380400.004702:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 91 00000100:00100000:3.0:1787380400.004713:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:10457:x1874203915629568:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:3.0:1787380400.004823:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.004846:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.004860:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.004878:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.004886:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.004893:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007562:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007598:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007618:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380400.007679:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007695:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007702:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007710:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007716:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.007732:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007751:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007766:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380400.007770:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.007775:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007783:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007803:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007810:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007816:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007822:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.007825:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007831:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007839:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968727ff00) 00010000:00010000:2.0:1787380400.007841:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.007851:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007858:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842a8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007877:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007883:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007888:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007893:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.007895:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007902:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007910:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:2.0:1787380400.007912:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.007915:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.007920:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842a95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.008053:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:10457:x1874203915629568:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 3326us (4072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.008066:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 91 00000100:00100000:1.0:1787380400.074396:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.074551:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915629824 00000100:00100000:3.0:1787380400.074582:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915629824 00000100:00100000:3.0:1787380400.074665:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 92 00000100:00100000:3.0:1787380400.074678:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:10460:x1874203915629824:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380400.074717:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380400.074753:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842a9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6861 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.074857:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.074877:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.074891:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.074909:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.074917:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.074924:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075329:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075375:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075384:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380400.075404:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787380400.075521:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075529:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075536:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075543:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380400.075548:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075556:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075570:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380400.075573:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380400.075577:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075583:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075599:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075606:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075624:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075629:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380400.075632:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075638:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075646:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968727fc00) 00010000:00010000:3.0:1787380400.075648:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380400.075651:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075656:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075716:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842a9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6861 expref: 30 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075732:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6861 expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.075738:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380400.075741:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787380400.075743:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ce00, rc 0) 00000100:00100000:3.0:1787380400.075836:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:10460:x1874203915629824:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1160us (1517us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787380400.075855:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 92 00000100:00100000:1.0:1787380400.082210:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380400.082370:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915629952 00000100:00100000:2.0:1787380400.082383:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915629952 00000100:00100000:2.0:1787380400.082464:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 93 00000100:00100000:2.0:1787380400.082476:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:10460:x1874203915629952:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:2.0:1787380400.082567:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.082588:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.082597:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.082644:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 29 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.082661:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 29 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.082678:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935574016:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380400.082802:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a0ea7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380400.094056:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.094147:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915630208 00000100:00100000:0.0:1787380400.094159:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915630208 00000100:00100000:0.0:1787380400.094239:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:0.0:1787380400.094251:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:5567:x1874203915630208:12345-192.168.206.14@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787380400.094724:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:5567:x1874203915630208:12345-192.168.206.14@tcp:35:ldlm_bl.0 Request processed in 474us (684us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787380400.094733:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:1.0:1787380400.095133:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935574016:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380400.095179:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380400.099012:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.100427:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915630336 00000100:00100000:0.0:1787380400.100446:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915630336 00010000:00010000:0.0:1787380400.100518:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 31 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.100582:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:0.0:1787380400.100594:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:2355:x1874203915630336:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380400.100624:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380400.100633:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 31 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.100649:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 31 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.100680:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842a64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f684c expref: 31 pid: 5786 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.100976:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:0.0:1787380400.100984:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.100996:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.101006:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.101052:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380400.101131:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:2355:x1874203915630336:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 538us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380400.101158:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 48 00010000:00010000:2.0:1787380400.101394:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101404:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101443:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101459:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101466:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101472:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.101477:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101486:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101496:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:2.0:1787380400.101499:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380400.101503:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.101509:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.101557:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:10460:x1874203915629952:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 19084us (19363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.101578:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 93 00000100:00100000:3.0:1787380400.115298:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.116015:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915630592 00000100:00100000:0.0:1787380400.116030:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915630592 00000100:00100000:0.0:1787380400.116094:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:0.0:1787380400.116106:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:10460:x1874203915630592:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380400.116541:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:10460:x1874203915630592:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 436us (1259us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787380400.116551:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:3.0:1787380400.276762:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380400.281364:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915630848 00000100:00100000:1.0:1787380400.281534:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915630848 00000100:00100000:1.0:1787380400.281977:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 94 00000100:00100000:1.0:1787380400.281992:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+30:10471:x1874203915630848:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:1.0:1787380400.282025:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380400.282053:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6868 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282143:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282160:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282185:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282202:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282210:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282216:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282703:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282714:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282721:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380400.282733:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787380400.282858:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282866:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282874:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282881:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380400.282886:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282895:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282909:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:1.0:1787380400.282912:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380400.282917:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282935:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282949:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282956:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282961:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282967:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380400.282970:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282976:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282985:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968911da00) 00010000:00010000:1.0:1787380400.282987:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380400.282990:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.282996:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118842ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.283049:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6868 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.283063:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6868 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.283077:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:1.0:1787380400.283079:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380400.283082:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e800, rc 0) 00000100:00100000:1.0:1787380400.283196:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:10471:x1874203915630848:12345-192.168.206.14@tcp:101:cat.0 Request processed in 1206us (6449us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787380400.283205:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 94 00000100:00100000:3.0:1787380400.292134:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.294934:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915631104 00000100:00100000:0.0:1787380400.294955:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915631104 00000100:00100000:0.0:1787380400.295081:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:0.0:1787380400.295093:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:10471:x1874203915631104:12345-192.168.206.14@tcp:35:cat.0 00000100:00100000:0.0:1787380400.295929:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:10471:x1874203915631104:12345-192.168.206.14@tcp:35:cat.0 Request processed in 833us (3805us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787380400.295941:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:0.0:1787380400.337750:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.337813:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915631360 00000100:00100000:3.0:1787380400.337826:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915631360 00000100:00100000:3.0:1787380400.337904:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 95 00000100:00100000:3.0:1787380400.337916:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:10472:x1874203915631360:12345-192.168.206.14@tcp:36:rm.0 00010000:00010000:3.0:1787380400.337998:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787380400.338032:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6868 expref: 33 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338060:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6861 expref: 32 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338076:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842a79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6853 expref: 31 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338086:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380400.338100:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380400.338125:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338140:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338151:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338196:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338205:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338211:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338936:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338960:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.338968:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380400.341861:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787380400.341882:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350653543251ns, next at 351653538390ns, rc = 0 00010000:00010000:2.0:1787380400.341981:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342001:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342026:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342035:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342043:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342049:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342074:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380400.342106:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342113:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342120:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342126:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.342131:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342139:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342153:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:2.0:1787380400.342157:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787380400.342179:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342186:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842af7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342221:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342228:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342234:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342239:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.342242:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342248:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342257:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380400.342260:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.342263:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.342269:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842ae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380400.342282:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d6d6976 reply state 00000000053269e0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.342304:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787380400.342909:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380400.342918:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.342926:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380400.342930:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.342937:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.342949:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:3.0:1787380400.342952:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787380400.342964:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.342970:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842afe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.342990:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380400.342992:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380400.342994:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380400.343060:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:10472:x1874203915631360:12345-192.168.206.14@tcp:36:rm.0 Request processed in 5139us (5317us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787380400.343072:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 95 00010000:00010000:1.0:1787380400.356640:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.356667:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.356676:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.356683:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380400.356690:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.356697:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.356718:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968727fc00) 00010000:00010000:1.0:1787380400.356722:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380400.356727:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.356734:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842af0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.438710:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.438868:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915631616 00000100:00100000:3.0:1787380400.438882:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915631616 00000100:00100000:3.0:1787380400.438962:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 96 00000100:00100000:3.0:1787380400.438974:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:10478:x1874203915631616:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380400.439006:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380400.439033:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f686f expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.439219:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.439237:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.439252:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.439270:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.439277:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.439306:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380400.440381:0:7761:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787380400.441826:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441852:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441866:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441913:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441921:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441928:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441934:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380400.441939:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441946:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441961:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380400.441965:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380400.441986:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.441993:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b0c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380400.442012:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2034333 reply state 00000000329e3027 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380400.442021:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787380400.442064:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 34 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.442081:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 33 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.442090:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380400.442093:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380400.442096:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380400.442212:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:10478:x1874203915631616:12345-192.168.206.14@tcp:101:bash.0 Request processed in 3239us (3515us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787380400.442223:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 96 00010000:00010000:1.0:1787380400.448586:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.448610:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.448619:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.448626:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380400.448631:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.448639:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.448660:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d968727fd00) 00010000:00010000:1.0:1787380400.448664:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380400.448669:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.448675:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842b13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380400.450858:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380400.451227:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915631744 00000100:00100000:2.0:1787380400.451256:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915631744 00000100:00100000:2.0:1787380400.451393:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:2.0:1787380400.451406:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915631744:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380400.451428:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380400.452103:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6876 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380400.452142:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787380400.452176:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1787380400.452183:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380400.452196:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.452219:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.452234:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2e00, rc 0) 00000100:00100000:2.0:1787380400.452367:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915631744:12345-192.168.206.14@tcp:101:bash.0 Request processed in 964us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.452385:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00080000:3.0:1787380400.457605:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380400.467077:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.468507:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915631872 00000100:00100000:0.0:1787380400.468524:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915631872 00000100:00100000:0.0:1787380400.468597:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:0.0:1787380400.468607:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:10478:x1874203915631872:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:0.0:1787380400.468629:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380400.468650:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f687d expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.468709:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.468719:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380400.468724:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380400.468729:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.468768:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.468781:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 7 pid: 6576 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.468796:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1874203935574144:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380400.468906:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380400.476882:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380400.476990:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915632000 00000100:00100000:2.0:1787380400.477003:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915632000 00010000:00010000:2.0:1787380400.477057:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 8 pid: 6576 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.477111:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:2.0:1787380400.477123:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915632000:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380400.477144:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380400.477187:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 8 pid: 6576 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.477205:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 8 pid: 6576 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.477239:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380400.477246:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380400.477257:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.477269:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.477317:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.477334:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5771:1874203935574272:192.168.206.14@tcp:105: 00000100:00100000:2.0:1787380400.477509:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968a0cda80 going to sleep for 11 seconds 00010000:00010000:0.0:1787380400.477978:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000470f27b7/0x651a07d118842b28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6876 expref: 8 pid: 6576 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.477998:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1874203935574144:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380400.478027:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.478039:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e400, rc 0) 00000100:00100000:0.0:1787380400.478101:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:10478:x1874203915631872:12345-192.168.206.14@tcp:101:bash.0 Request processed in 9494us (11037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380400.478110:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:2.0:1787380400.485128:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5771:1874203935574272:192.168.206.14@tcp:105: 00010000:00010000:2.0:1787380400.485178:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380400.485267:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c51450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915632000:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 8145us (8400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.485281:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:1.0:1787380400.485969:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.486129:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915632256 00000100:00100000:3.0:1787380400.486138:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915632256 00000100:00100000:3.0:1787380400.486209:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:3.0:1787380400.486220:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:10478:x1874203915632256:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:3.0:1787380400.486954:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:10478:x1874203915632256:12345-192.168.206.14@tcp:35:bash.0 Request processed in 730us (982us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787380400.486982:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00010000:00010000:2.0:1787380400.632238:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380400.715329:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380400.715473:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915632384 00000100:00100000:2.0:1787380400.715486:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915632384 00000100:00100000:2.0:1787380400.715570:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 97 00000100:00100000:2.0:1787380400.715581:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:10494:x1874203915632384:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380400.715611:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380400.715639:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842b36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6884 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.715719:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.715736:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.715751:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380400.715833:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787380400.715837:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380400.715863:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.715914:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6884 expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.715934:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6884 expref: 35 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.715943:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380400.715946:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380400.715950:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2e00, rc 0) 00000100:00100000:2.0:1787380400.716025:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:10494:x1874203915632384:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 446us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.716032:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 97 00000100:00100000:1.0:1787380400.725961:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.726058:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915632640 00000100:00100000:3.0:1787380400.726071:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915632640 00000100:00100000:3.0:1787380400.726152:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 98 00000100:00100000:3.0:1787380400.726174:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:10494:x1874203915632640:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380400.726199:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380400.726224:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f688b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.726418:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.726436:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.726449:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380400.726463:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787380400.726739:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f688b expref: 38 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.726763:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f688b expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.726774:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380400.726777:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380400.726781:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c800, rc 0) 00000100:00100000:3.0:1787380400.726901:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:10494:x1874203915632640:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 738us (954us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787380400.726909:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 98 00000100:00100000:3.0:1787380400.734809:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380400.737141:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.737247:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915633024 00000100:00100000:3.0:1787380400.737260:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915633024 00000100:00100000:3.0:1787380400.737387:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:3.0:1787380400.737399:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:2353:x1874203915633024:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380400.737419:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380400.737453:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f688b expref: 37 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.737477:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:3.0:1787380400.737483:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380400.737917:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:2353:x1874203915633024:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 517us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380400.737927:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:2.0:1787380400.739411:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915632896 00000100:00100000:2.0:1787380400.739431:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915632896 00000100:00100000:2.0:1787380400.739526:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 99 00000100:00100000:2.0:1787380400.739538:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:10494:x1874203915632896:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380400.739572:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380400.739599:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842b59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6892 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.739744:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842b60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.739764:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.739781:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842b60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380400.739817:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787380400.740244:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842b59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6892 expref: 39 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.740268:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842b60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6892 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.740277:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:2.0:1787380400.740280:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380400.740284:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2600, rc 0) 00000100:00100000:2.0:1787380400.740415:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:10494:x1874203915632896:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 879us (5620us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787380400.740424:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 99 00000100:00100000:1.0:1787380400.752157:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.752298:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915633152 00000100:00100000:0.0:1787380400.752309:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915633152 00000100:00100000:0.0:1787380400.752423:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:0.0:1787380400.752435:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915633152:12345-192.168.206.14@tcp:1:lfs.0 00010000:00010000:0.0:1787380400.752493:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.752515:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.753063:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787380400.753071:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380400.753077:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.753124:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.753142:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 6 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.753171:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1874203935574400:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380400.753294:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380400.759081:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1874203935574400:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380400.759119:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380400.759687:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380400.759695:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380400.759758:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787380400.759764:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380400.763742:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.763852:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915633280 00000100:00100000:0.0:1787380400.763864:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915633280 00002000:00100000:0.0:1787380400.763933:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d96bd0a2300 x1874203915633280/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:206/0 lens 504/0 e 0 to 0 dl 1787380411 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380400.763945:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bd0a2300 with x1874203915633280 ext(0->8) 00010000:00010000:0.0:1787380400.763958:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 7 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.763977:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 7 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380400.763986:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96bd0a2300 00000100:00100000:0.0:1787380400.764025:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:0.0:1787380400.764035:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915633280:12345-192.168.206.14@tcp:4:lfs.0 00000100:00100000:0.0:1787380400.765110:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915633280:12345-192.168.206.14@tcp:4:lfs.0 Request processed in 1066us (1373us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787380400.765123:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00002000:00100000:0.0:1787380400.765133:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d96bd0a2300 x1874203915633280/t4294967302(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:206/0 lens 504/448 e 0 to 0 dl 1787380411 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380400.765144:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bd0a2300 with x1874203915633280 ext(0->8) 00010000:00010000:0.0:1787380400.765152:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.765187:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380400.765195:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96bd0a2300 00000100:00100000:3.0:1787380400.776566:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380400.777265:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915633408 00000100:00100000:1.0:1787380400.777280:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915633408 00010000:00010000:1.0:1787380400.777408:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380400.777458:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:1.0:1787380400.777471:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2355:x1874203915633408:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380400.777490:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787380400.777515:0:5772:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787380400.777519:0:5772:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787380400 00002000:00010000:1.0:1787380400.777521:0:5772:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787380400 00002000:00010000:1.0:1787380400.777532:0:5772:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787380400 00010000:00010000:1.0:1787380400.777540:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.777556:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.777587:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118842b2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f687d expref: 9 pid: 6578 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.777620:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380400.777643:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380400.777651:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.777663:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.777693:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380400.777770:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915633408:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 302us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380400.777778:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 50 00010000:00010000:0.0:1787380400.778979:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.778998:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.779042:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.779051:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.779060:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.779068:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ea00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380400.779073:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.779084:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.779129:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.779137:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5ce2762/0x651a07d118842b6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.780076:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2354:x1874203915633152:12345-192.168.206.14@tcp:1:lfs.0 Request processed in 27630us (27920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380400.780093:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:1.0:1787380400.789817:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380400.790040:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915633664 00000100:00100000:0.0:1787380400.790065:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915633664 00000100:00100000:0.0:1787380400.790142:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:0.0:1787380400.790154:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:10494:x1874203915633664:12345-192.168.206.14@tcp:35:lfs.0 00000004:00010000:0.0:1787380400.790316:0:5790:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842b60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6892 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380400.790767:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787380400.790820:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787380400.792202:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1787380400.792289:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.792310:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 42 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.792555:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.792691:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 42 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.792710:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 42 pid: 7761 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.792728:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1874203935574528:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380400.792907:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380400.797843:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5790:1874203935574528:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380400.797880:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380400.798137:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380400.798263:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915633792 00000100:00100000:2.0:1787380400.798272:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915633792 00010000:00010000:2.0:1787380400.798319:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 43 pid: 7761 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.798454:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:2.0:1787380400.798466:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:2355:x1874203915633792:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380400.798487:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380400.798496:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 43 pid: 7761 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.798510:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 43 pid: 7761 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.798743:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f686f expref: 43 pid: 7761 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.798767:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:2.0:1787380400.798773:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.798784:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.798791:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.798917:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380400.798977:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+42:2355:x1874203915633792:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 513us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.798985:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 51 00010000:00010000:1.0:1787380400.799032:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380400.799040:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380400.799208:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1787380400.799988:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787380400.800150:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd0a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1874203935574656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787380400.800230:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380400.800312:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380400.800455:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935574656 00000100:00100000:2.0:1787380400.800462:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935574656 00000100:00080000:0.0:1787380400.800586:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380400.801002:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380400.801014:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1874203935574656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787380400.801123:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5790:x1874203935574656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.801131:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380400.801214:0:5790:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787380400.801225:0:5790:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1787380400.801249:0:5790:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b5159500, transno 4294967301 00000100:00100000:0.0:1787380400.801272:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd0a0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1874203935574656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787380400.803236:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1787380400.804838:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1874203935574784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787380400.804937:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380400.805014:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380400.805063:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935574784 00000100:00100000:1.0:1787380400.805072:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935574784 00000100:00100000:1.0:1787380400.805180:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380400.805191:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5790:x1874203935574784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787380400.805496:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5790:x1874203935574784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 305us (559us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787380400.805520:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380400.805626:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5790:1874203935574784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787380400.805707:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787380400.805765:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.805789:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.805798:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.805804:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ea00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380400.805810:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.805818:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.805837:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:0.0:1787380400.805840:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787380400.805845:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380400.805851:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ea00/0x651a07d118842b75 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380400.806069:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787380400.806185:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787380400.806199:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351117859629ns, next at 352117857139ns, rc = 0 00000001:00080000:0.0:1787380400.806205:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1787380400.806246:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727fa00) 00010000:00010000:0.0:1787380400.806249:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787380400.806257:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842b60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6892 expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380400.806446:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e18450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:10494:x1874203915633664:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 16293us (16642us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787380400.806455:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 26 00000020:00080000:0.0:1787380400.806460:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787380400.816895:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.820544:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915633920 00000100:00100000:3.0:1787380400.820567:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915633920 00000100:00100000:3.0:1787380400.820675:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 100 00000100:00100000:3.0:1787380400.820686:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:10494:x1874203915633920:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380400.820720:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380400.820752:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6899 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.820831:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6899 expref: 46 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.820872:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6899 expref: 46 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.820902:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380400.820905:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380400.820910:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ce00, rc 0) 00000100:00100000:3.0:1787380400.820990:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+46:10494:x1874203915633920:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 305us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380400.820998:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 100 00000100:00100000:2.0:1787380400.825679:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.825779:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915634176 00000100:00100000:3.0:1787380400.825793:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915634176 00000100:00100000:3.0:1787380400.825867:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:3.0:1787380400.825880:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+46:10494:x1874203915634176:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:3.0:1787380400.826201:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:10494:x1874203915634176:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 322us (536us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787380400.826211:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:0.0:1787380400.887834:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935575040:0@lo:400:kworker.0 00000100:00100000:0.0:1787380400.887930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380400.888017:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787380400.888023:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935574912:0@lo:400:kworker.0 00000100:00100000:0.0:1787380400.888055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380400.888080:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935575424:0@lo:400:kworker.0 00000100:00100000:0.0:1787380400.888101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380400.888134:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935574912 00000100:00100000:0.0:1787380400.888142:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935574912 00000100:00100000:0.0:1787380400.888205:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787380400.888215:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935574912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380400.888273:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935574912:12345-0@lo:400:kworker.0 Request processed in 59us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380400.888281:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787380400.888442:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935574912:0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.888542:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935575296:0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.888581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380400.888641:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380400.888648:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935575168:0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.888674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380400.888711:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935575040 00000100:00100000:2.0:1787380400.888715:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935575040 00000100:00100000:2.0:1787380400.888751:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935575424 00000100:00100000:2.0:1787380400.888754:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935575424 00000100:00100000:2.0:1787380400.888776:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935575168 00000100:00100000:2.0:1787380400.888779:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935575168 00000100:00100000:2.0:1787380400.888794:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787380400.888801:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935575040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.888841:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935575040:12345-0@lo:400:kworker.0 Request processed in 40us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.888848:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787380400.888861:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787380400.888867:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935575424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.888893:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935575424:12345-0@lo:400:kworker.0 Request processed in 26us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.888899:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787380400.888912:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787380400.888917:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935575168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.888945:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935575168:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.888951:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1787380400.888966:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380400.888988:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935575168:0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.889008:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935575424:0@lo:400:kworker.0 00000100:00100000:2.0:1787380400.889027:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935575040:0@lo:400:kworker.0 00000100:00100000:0.0:1787380400.889177:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935575296 00000100:00100000:0.0:1787380400.889181:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935575296 00000100:00100000:0.0:1787380400.889222:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787380400.889229:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874203935575296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380400.889262:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1874203935575296:12345-0@lo:400:kworker.0 Request processed in 34us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380400.889274:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787380400.890582:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380400.890651:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935575296:0@lo:400:kworker.0 00000100:00100000:0.0:1787380400.924019:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380400.924137:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915634304 00000100:00100000:2.0:1787380400.924150:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915634304 00000100:00100000:2.0:1787380400.924247:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 101 00000100:00100000:2.0:1787380400.924258:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:10504:x1874203915634304:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:2.0:1787380400.924413:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924435:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924449:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924467:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924474:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924482:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924785:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924794:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924821:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380400.924871:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924886:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924893:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924900:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924905:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.924910:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924919:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924932:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380400.924935:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.924940:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924946:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842b83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924961:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924972:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924978:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924982:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.924984:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924990:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.924998:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d969371a900) 00010000:00010000:2.0:1787380400.925000:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.925003:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925009:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925026:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925032:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925038:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925043:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.925053:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925059:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925067:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380400.925069:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.925072:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.925078:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380400.925174:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:10504:x1874203915634304:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 906us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380400.925184:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 101 00000100:00100000:1.0:1787380400.962686:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380400.962903:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915634560 00000100:00100000:2.0:1787380400.962916:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915634560 00000100:00100000:2.0:1787380400.962989:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 102 00000100:00100000:2.0:1787380400.962999:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:10507:x1874203915634560:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380400.963025:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380400.963051:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68a0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963140:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963169:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963203:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963218:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963225:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963230:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963435:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963444:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963450:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380400.963462:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787380400.963746:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963755:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963761:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963768:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.963783:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963793:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963809:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380400.963812:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.963818:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963824:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842b9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963840:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963846:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963852:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963857:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380400.963860:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963866:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963873:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d969371a900) 00010000:00010000:2.0:1787380400.963875:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380400.963887:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963893:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963949:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842b98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963964:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 49 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380400.963972:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380400.963974:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380400.963977:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3c00, rc 0) 00000100:00100000:2.0:1787380400.964053:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+49:10507:x1874203915634560:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1055us (1381us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787380400.964063:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 102 00000100:00100000:0.0:1787380400.968252:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.968403:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915634688 00000100:00100000:3.0:1787380400.968417:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915634688 00000100:00100000:3.0:1787380400.968484:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 103 00000100:00100000:3.0:1787380400.968495:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+49:10507:x1874203915634688:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:3.0:1787380400.968740:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968761:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968795:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968830:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968837:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968844:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968850:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380400.968855:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968862:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968877:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380400.968881:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380400.968887:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380400.968892:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380400.968991:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+49:10507:x1874203915634688:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 496us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380400.969000:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 103 00000100:00100000:0.0:1787380400.975606:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380400.975690:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915634944 00000100:00100000:3.0:1787380400.975721:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915634944 00000100:00100000:3.0:1787380400.975789:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:3.0:1787380400.975801:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+49:10507:x1874203915634944:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:3.0:1787380400.976116:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:10507:x1874203915634944:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 316us (532us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787380400.976124:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:1.0:1787380401.054670:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.054778:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915635200 00000100:00100000:2.0:1787380401.054791:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915635200 00000100:00100000:2.0:1787380401.054888:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:2.0:1787380401.054901:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:10517:x1874203915635200:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380401.054931:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380401.054935:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787380401.054969:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6884 expref: 50 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.054992:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380401.054998:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380401.055024:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842bc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68a7 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.055152:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.055180:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.055191:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.055231:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.055249:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 50 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380401.055265:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935575552:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380401.055452:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968a0cdb40 going to sleep for 11 seconds 00000100:00080000:0.0:1787380401.056089:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380401.059403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.059511:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915635328 00000100:00100000:3.0:1787380401.059522:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915635328 00010000:00010000:3.0:1787380401.059585:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 51 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.059629:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:3.0:1787380401.059639:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:2356:x1874203915635328:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380401.059655:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380401.059663:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 51 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.059677:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 51 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.059702:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380401.059707:0:11008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.059718:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.059725:0:11008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.059763:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380401.059826:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:2356:x1874203915635328:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 188us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.059834:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 52 00010000:00010000:1.0:1787380401.060830:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842bad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a0 expref: 50 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380401.060854:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935575552:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380401.060880:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.060891:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.060897:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380401.060919:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787380401.061102:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842bc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.061116:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 50 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.061125:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:1.0:1787380401.061128:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380401.061131:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3000, rc 0) 00000100:00100000:1.0:1787380401.061203:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:10517:x1874203915635200:12345-192.168.206.14@tcp:101:bash.0 Request processed in 6304us (6549us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787380401.061223:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:2.0:1787380401.065915:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.066022:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915635584 00000100:00100000:3.0:1787380401.066035:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915635584 00000100:00100000:3.0:1787380401.066111:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 105 00000100:00100000:3.0:1787380401.066121:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:10517:x1874203915635584:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:3.0:1787380401.066520:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.066542:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.066556:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380401.066623:0:7761:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1787380401.066650:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d0f4c04 reply state 00000000b533da75 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.066660:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380401.066769:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10517:x1874203915635584:12345-192.168.206.14@tcp:36:bash.0 Request processed in 647us (868us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787380401.066777:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 105 00000020:00080000:3.0:1787380401.066783:0:7761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380401.070096:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.070119:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.070129:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.070135:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380401.070141:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.070150:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.070184:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:1.0:1787380401.070188:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380401.070193:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.070199:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842bd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380401.074734:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.074835:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915635712 00000100:00100000:3.0:1787380401.074851:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915635712 00000100:00100000:3.0:1787380401.074927:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 106 00000100:00100000:3.0:1787380401.074956:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:10517:x1874203915635712:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380401.074987:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380401.075012:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68ae expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.075113:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.075131:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.075141:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.075197:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.075213:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 53 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.075231:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935575680:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380401.075560:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380401.079090:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.079246:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935575680:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380401.079294:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380401.079858:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915635840 00000100:00100000:2.0:1787380401.079868:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915635840 00010000:00010000:2.0:1787380401.079915:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 54 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380401.079959:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:2.0:1787380401.079985:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:2355:x1874203915635840:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380401.080003:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380401.080010:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 54 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.080024:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 54 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.080049:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68a7 expref: 54 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.080064:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380401.080070:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.080081:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.080089:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.080118:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380401.080192:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:2355:x1874203915635840:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 207us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380401.080200:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 53 00010000:00010000:3.0:1787380401.080264:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.080284:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380401.080371:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787380401.080377:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380401.080406:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.080447:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 53 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.080467:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 52 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.080475:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380401.080478:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380401.080481:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d800, rc 0) 00000100:00100000:3.0:1787380401.080512:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:10517:x1874203915635712:12345-192.168.206.14@tcp:101:bash.0 Request processed in 5560us (5794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.080520:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 106 00000100:00100000:2.0:1787380401.085122:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.085248:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915636096 00000100:00100000:3.0:1787380401.085260:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915636096 00000100:00100000:3.0:1787380401.085331:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:3.0:1787380401.085378:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:10517:x1874203915636096:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:3.0:1787380401.085695:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10517:x1874203915636096:12345-192.168.206.14@tcp:35:bash.0 Request processed in 319us (586us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787380401.085703:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:1.0:1787380401.148037:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.148143:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915636224 00000100:00100000:3.0:1787380401.148156:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915636224 00000100:00100000:3.0:1787380401.148247:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 107 00000100:00100000:3.0:1787380401.148259:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:10523:x1874203915636224:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380401.148295:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380401.148323:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842bec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68b5 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.148455:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.148472:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.148485:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380401.148562:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787380401.148566:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380401.148592:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.148634:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842bec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68b5 expref: 55 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.148657:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68b5 expref: 54 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.148667:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380401.148671:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380401.148691:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c000, rc 0) 00000100:00100000:3.0:1787380401.148772:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10523:x1874203915636224:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 514us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.148780:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 107 00000100:00100000:1.0:1787380401.152475:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.152624:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915636352 00000100:00100000:2.0:1787380401.152637:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915636352 00000100:00100000:2.0:1787380401.152708:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 108 00000100:00100000:2.0:1787380401.152738:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10523:x1874203915636352:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380401.152766:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380401.152794:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68bc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.152875:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.152891:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.152904:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.152921:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.152929:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.152935:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153062:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153072:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153080:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380401.153134:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787380401.153138:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380401.153179:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153193:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153201:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153208:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153215:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153222:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380401.153227:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153235:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153248:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380401.153252:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380401.153257:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153263:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153290:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153296:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153303:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153309:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380401.153312:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153318:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153326:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d969371a900) 00010000:00010000:2.0:1787380401.153328:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380401.153331:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153380:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153418:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842bfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153433:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.153453:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380401.153456:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380401.153459:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3200, rc 0) 00000100:00100000:2.0:1787380401.153532:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10523:x1874203915636352:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 797us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380401.153541:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 108 00000100:00100000:1.0:1787380401.158255:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.158381:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915636608 00000100:00100000:3.0:1787380401.158394:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915636608 00000100:00100000:3.0:1787380401.158468:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 109 00000100:00100000:3.0:1787380401.158480:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10523:x1874203915636608:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380401.158508:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380401.158534:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68c3 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.158680:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.158697:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 56 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.158705:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.158714:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.158755:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 56 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.158769:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 56 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.158808:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935575808:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380401.158939:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 56 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.158948:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 56 pid: 5788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.158958:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935575936:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380401.158984:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91780 going to sleep for 11 seconds 00000100:00100000:1.0:1787380401.164248:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:3.0:1787380401.164500:0:7761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.14@tcp) returned -22 from blocking AST (req@000000006b681409 x1874203935575808) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 56 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.164527:0:7761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 56 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.164556:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68bc expref: 56 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.164588:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935575808:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380401.164604:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935575936:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380401.164632:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380401.164638:0:7761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.164668:0:7761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.164677:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380401.164794:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915636736 00000100:00100000:0.0:1787380401.164803:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915636736 00000100:00100000:0.0:1787380401.164877:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:0.0:1787380401.164889:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:2356:x1874203915636736:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380401.164907:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380401.164910:0:5773:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 651a07d118842c0f) 00010000:00010000:0.0:1787380401.164912:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380401.164979:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:2356:x1874203915636736:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 92us (746us total) trans 0 rc 116/116 00000100:00100000:0.0:1787380401.164988:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:1.0:1787380401.165358:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.165975:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915636864 00000100:00100000:3.0:1787380401.165984:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915636864 00010000:00010000:3.0:1787380401.166014:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 56 pid: 5788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.166044:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:3.0:1787380401.166054:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:2356:x1874203915636864:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380401.166065:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380401.166072:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 56 pid: 5788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.166085:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 56 pid: 5788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.166105:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ae expref: 56 pid: 5788 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.166124:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380401.166129:0:11008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.166140:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.166156:0:11008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.166194:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380401.166238:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:2356:x1874203915636864:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 185us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.166250:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 54 00010000:00010000:3.0:1787380401.166310:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.166319:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380401.166541:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787380401.167215:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 56 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.167244:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 55 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.167253:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380401.167257:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380401.167260:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c400, rc 0) 00000100:00100000:3.0:1787380401.167307:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10523:x1874203915636608:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 8830us (9067us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787380401.167316:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 109 00000100:00100000:2.0:1787380401.171533:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380401.171704:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915637120 00000100:00100000:0.0:1787380401.171719:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915637120 00000100:00100000:0.0:1787380401.171809:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:0.0:1787380401.171822:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10523:x1874203915637120:12345-192.168.206.14@tcp:103:lfs.0 00010000:00010000:0.0:1787380401.171847:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380401.171880:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6899 expref: 55 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.171909:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:0.0:1787380401.171915:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380401.172008:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10523:x1874203915637120:12345-192.168.206.14@tcp:103:lfs.0 Request processed in 188us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380401.172017:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:1.0:1787380401.175287:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.175692:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915637248 00000100:00100000:2.0:1787380401.175706:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915637248 00000100:00100000:2.0:1787380401.175781:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 110 00000100:00100000:2.0:1787380401.175791:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10523:x1874203915637248:12345-192.168.206.14@tcp:58:lfs.0 00010000:00010000:2.0:1787380401.175948:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.175971:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.175985:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380401.176284:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787380401.176448:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10523:x1874203915637248:12345-192.168.206.14@tcp:58:lfs.0 Request processed in 656us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380401.176457:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 110 00000100:00100000:1.0:1787380401.178918:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.179407:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915637376 00000100:00100000:2.0:1787380401.179421:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915637376 00000100:00100000:2.0:1787380401.179501:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 111 00000100:00100000:2.0:1787380401.179532:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:10523:x1874203915637376:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380401.179559:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380401.179603:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68ca expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.179677:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.179690:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.179716:0:5787:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.179730:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.179745:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380401.179748:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380401.179751:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 55 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.179759:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2c00, rc 0) 00000100:00100000:2.0:1787380401.179830:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10523:x1874203915637376:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 302us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380401.179838:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 111 00000100:00100000:3.0:1787380401.400124:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380401.400167:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935576064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380401.400277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380401.400843:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935576064 00000100:00100000:1.0:1787380401.400854:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935576064 00000100:00100000:1.0:1787380401.400915:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787380401.400927:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935576064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380401.400957:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380401.401021:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935576064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380401.401029:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787380401.401093:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935576064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380401.662541:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380401.784060:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380401.784074:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380401.784150:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787380401.784169:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380401.784335:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935576192:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787380401.785009:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380401.802289:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935576192:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787380401.806557:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.812075:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915637504 00000100:00100000:2.0:1787380401.812122:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915637504 00000100:00100000:2.0:1787380401.812229:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 112 00000100:00100000:2.0:1787380401.812242:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10524:x1874203915637504:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787380401.812303:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787380401.812523:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10524:x1874203915637504:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 283us (5979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380401.812532:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 112 00000100:00100000:1.0:1787380401.818514:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.818674:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915637632 00000100:00100000:2.0:1787380401.818687:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915637632 00000100:00100000:2.0:1787380401.818770:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 113 00000100:00100000:2.0:1787380401.818783:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10524:x1874203915637632:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787380401.818882:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.818904:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.818920:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821292:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821396:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821409:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821444:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821451:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821456:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380401.821499:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787380401.821503:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380401.821515:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821526:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821532:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821538:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821572:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380401.821576:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821584:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821596:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:0.0:1787380401.821599:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380401.821603:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821610:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842c39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821627:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821633:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821638:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821643:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380401.821646:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821652:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821671:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9d96991e8e00) 00010000:00010000:0.0:1787380401.821673:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380401.821676:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821682:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c40 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821971:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821978:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821984:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821989:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380401.821992:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.821998:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.822007:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:0.0:1787380401.822009:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380401.822012:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.822017:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380401.822206:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5196a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10524:x1874203915637632:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 Request processed in 3422us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380401.822217:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 113 00000100:00100000:1.0:1787380401.826221:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.826977:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915637888 00000100:00100000:2.0:1787380401.826997:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915637888 00000100:00100000:2.0:1787380401.827088:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 114 00000100:00100000:2.0:1787380401.827099:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:10524:x1874203915637888:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380401.827121:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380401.827140:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842c4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68d1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827275:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827289:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827301:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380401.827323:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787380401.827488:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827501:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827510:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827517:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380401.827524:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827531:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827550:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380401.827553:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787380401.827558:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827578:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d118842c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827618:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842c4e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68d1 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827628:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:2.0:1787380401.827631:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380401.827635:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842c4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68d1 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.827644:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2e00, rc 0) 00000100:00100000:2.0:1787380401.827924:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5195500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10524:x1874203915637888:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 826us (1713us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1787380401.827933:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 114 00000100:00100000:1.0:1787380401.838451:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.838552:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915638016 00000100:00100000:3.0:1787380401.838565:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915638016 00000100:00100000:3.0:1787380401.838626:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 115 00000100:00100000:3.0:1787380401.838635:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10524:x1874203915638016:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380401.838671:0:7761:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380401.838770:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10524:x1874203915638016:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.838777:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 115 00000100:00100000:0.0:1787380401.842539:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.844833:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915638272 00000100:00100000:2.0:1787380401.844848:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915638272 00000100:00100000:0.0:1787380401.845080:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 116 00000100:00100000:0.0:1787380401.845090:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10524:x1874203915638272:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380401.845110:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380401.845114:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787380401.845139:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68b5 expref: 56 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.845180:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:0.0:1787380401.845184:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380401.845197:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68d8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380401.845622:0:5786:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787380401.845827:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.845841:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.845852:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.845903:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842c63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68d8 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.845933:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68d8 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.845941:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380401.845944:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380401.845947:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380401.846017:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:10524:x1874203915638272:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 928us (3487us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787380401.846025:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 116 00000100:00100000:1.0:1787380401.861693:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.862180:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915638528 00000100:00100000:3.0:1787380401.862192:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915638528 00000100:00100000:3.0:1787380401.862255:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 117 00000100:00100000:3.0:1787380401.862266:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:10524:x1874203915638528:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380401.862321:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380401.862382:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68d8 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862402:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:3.0:1787380401.862413:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380401.862434:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862447:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862457:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862535:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862554:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862561:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862634:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862643:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862650:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862656:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ca00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380401.862660:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862668:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862677:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:3.0:1787380401.862680:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380401.862684:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862690:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842c78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862709:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862715:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862720:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862725:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380401.862728:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862735:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862743:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2d85409e (ffff9d968727fd00) 00010000:00010000:3.0:1787380401.862746:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380401.862749:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.862754:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2d85409e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.862837:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5194380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10524:x1874203915638528:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 573us (1151us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380401.862844:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 117 00000100:00100000:1.0:1787380401.867924:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.868001:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915638656 00000100:00100000:3.0:1787380401.868010:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915638656 00000100:00100000:3.0:1787380401.868079:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 118 00000100:00100000:3.0:1787380401.868102:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:10524:x1874203915638656:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380401.868121:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380401.868143:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68df expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.868191:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.868205:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.868216:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.868303:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 58 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.868323:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 57 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.868331:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:3.0:1787380401.868334:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380401.868373:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d000, rc 0) 00000100:00100000:3.0:1787380401.868424:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:10524:x1874203915638656:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 325us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.868433:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 118 00000100:00100000:2.0:1787380401.872461:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.872761:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915638912 00000100:00100000:3.0:1787380401.872770:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915638912 00000100:00100000:3.0:1787380401.872827:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 119 00000100:00100000:3.0:1787380401.872851:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:10524:x1874203915638912:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380401.872924:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.872940:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.872952:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380401.873315:0:7761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787380401.873325:0:7761:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352184985986ns, next at 353184983879ns, rc = 0 00000004:00010000:3.0:1787380401.873583:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037be6cf3 reply state 0000000088a672da transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.873727:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380401.873823:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:10524:x1874203915638912:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 973us (1369us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787380401.873832:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 119 00010000:00010000:2.0:1787380401.875367:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.875395:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.875402:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.875408:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380401.875413:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.875435:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.875450:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:2.0:1787380401.875452:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787380401.875457:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.875462:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842c94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380401.875960:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.876676:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915639040 00000100:00100000:3.0:1787380401.876687:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915639040 00000100:00100000:3.0:1787380401.876787:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:3.0:1787380401.876797:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:10524:x1874203915639040:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380401.876820:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380401.876838:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68e6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.876891:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.876920:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.876942:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:3.0:1787380401.876945:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380401.876948:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216de00, rc 0) 00000100:00100000:3.0:1787380401.877011:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:10524:x1874203915639040:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 215us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.877019:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:1.0:1787380401.881748:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.881854:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915639168 00000100:00100000:2.0:1787380401.881864:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915639168 00000100:00100000:2.0:1787380401.881925:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:2.0:1787380401.881935:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915639168:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787380401.882233:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2355:x1874203915639168:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 299us (492us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787380401.882242:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00080000:0.0:1787380401.882898:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380401.889370:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.889480:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915639424 00000100:00100000:3.0:1787380401.889492:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915639424 00000100:00100000:3.0:1787380401.889601:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:3.0:1787380401.889612:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:10524:x1874203915639424:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787380401.889870:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:10524:x1874203915639424:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 260us (531us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787380401.889878:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:3.0:1787380401.893725:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.893942:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915639680 00000100:00100000:2.0:1787380401.893952:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915639680 00000100:00100000:2.0:1787380401.894997:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 121 00000100:00100000:2.0:1787380401.895010:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:10524:x1874203915639680:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787380401.895125:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:10524:x1874203915639680:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 116us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380401.895132:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 121 00000100:00100000:1.0:1787380401.898389:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380401.898477:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915639808 00000100:00100000:0.0:1787380401.898487:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915639808 00000100:00100000:0.0:1787380401.898594:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 122 00000100:00100000:0.0:1787380401.898606:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:10524:x1874203915639808:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380401.898626:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380401.898645:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842ca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68ed expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.898720:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.898734:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.898746:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380401.898793:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380401.898819:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.898844:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842ca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ed expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.898859:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ed expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.898868:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:0.0:1787380401.898871:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787380401.898874:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e600, rc 0) 00000100:00100000:0.0:1787380401.898931:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:10524:x1874203915639808:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 329us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380401.898937:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 122 00000100:00100000:1.0:1787380401.904651:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.904914:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915639936 00000100:00100000:2.0:1787380401.904929:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915639936 00000100:00100000:2.0:1787380401.904988:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:2.0:1787380401.904998:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915639936:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380401.905016:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380401.905039:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68f4 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380401.905240:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8942b1, blocks: 0x1 00010000:00010000:2.0:1787380401.905262:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787380401.905267:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380401.905277:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 10 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.905295:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 10 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.905308:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3c00, rc 0) 00000100:00100000:2.0:1787380401.905389:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2356:x1874203915639936:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 393us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380401.905397:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:2.0:1787380401.910184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380401.910268:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915640192 00000100:00100000:0.0:1787380401.910278:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915640192 00000100:00100000:0.0:1787380401.910540:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 123 00000100:00100000:1.0:1787380401.910810:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:10524:x1874203915640192:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787380401.910972:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:10524:x1874203915640192:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 415us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380401.910981:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 123 00000100:00100000:1.0:1787380401.914677:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380401.915271:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915640320 00000100:00100000:2.0:1787380401.915280:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915640320 00000100:00100000:2.0:1787380401.915334:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:2.0:1787380401.915424:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:10524:x1874203915640320:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380401.915442:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380401.915473:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f68fb expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.915572:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 11 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.915581:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380401.915586:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380401.915599:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 11 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.915648:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 11 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380401.915829:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 11 pid: 6577 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380401.915844:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935576320:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380401.915946:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968a0cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380401.919319:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.919582:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915640448 00000100:00100000:3.0:1787380401.919592:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915640448 00010000:00010000:3.0:1787380401.919631:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 12 pid: 6577 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.919675:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:3.0:1787380401.919695:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:2356:x1874203915640448:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380401.919724:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380401.919746:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 12 pid: 6577 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.919759:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 12 pid: 6577 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.919781:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380401.919785:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380401.919793:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 12 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.919803:0:11008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 12 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.920223:0:11008:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 12 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380401.920236:0:11008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11008:1874203935576448:192.168.206.14@tcp:105: 00000100:00100000:3.0:1787380401.920317:0:11008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91300 going to sleep for 11 seconds 00010000:00010000:1.0:1787380401.921168:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000503849a3/0x651a07d118842cb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68f4 expref: 12 pid: 6577 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380401.921190:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935576320:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380401.921214:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 11 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.921226:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3600, rc 0) 00000100:00100000:1.0:1787380401.921320:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:10524:x1874203915640320:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 5899us (6650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380401.921329:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:3.0:1787380401.924879:0:11008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11008:1874203935576448:192.168.206.14@tcp:105: 00010000:00010000:3.0:1787380401.924905:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380401.924994:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2356:x1874203915640448:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 5310us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380401.925004:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:3.0:1787380401.933860:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380401.934151:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915640576 00000100:00100000:0.0:1787380401.934173:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915640576 00002000:00100000:0.0:1787380401.934226:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d95877cc000 x1874203915640576/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:207/0 lens 504/0 e 0 to 0 dl 1787380412 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380401.934237:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d95877cc000 with x1874203915640576 ext(0->12) 00002000:00010000:0.0:1787380401.934243:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d95877cc000 00000100:00100000:0.0:1787380401.934274:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:0.0:1787380401.934283:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2356:x1874203915640576:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787380401.934781:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:2356:x1874203915640576:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 Request processed in 497us (929us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787380401.934790:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00002000:00100000:0.0:1787380401.934799:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d95877cc000 x1874203915640576/t4294967308(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:207/0 lens 504/448 e 0 to 0 dl 1787380412 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380401.935130:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d95877cc000 with x1874203915640576 ext(0->12) 00002000:00010000:0.0:1787380401.935136:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d95877cc000 00000100:00100000:2.0:1787380401.939441:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380401.939589:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915640704 00000100:00100000:3.0:1787380401.939608:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915640704 00000100:00100000:3.0:1787380401.939666:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 124 00000100:00100000:3.0:1787380401.939676:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:10524:x1874203915640704:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787380401.987229:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787380401.987247:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787380401.987271:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d9698d1fc00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787380401.987276:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d96b5b14100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d9698d1f0c0 00000020:00080000:2.0:1787380401.987279:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9689c65a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d96b5170000 00000020:00080000:2.0:1787380401.987330:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d9698d42600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787380401.987333:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d96b5b14f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d9698d42b40 00000100:00100000:0.0:1787380401.987549:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935576576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787380401.987686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380401.987743:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935576576 00000100:00100000:0.0:1787380401.987749:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935576576 00000100:00100000:0.0:1787380401.987789:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787380401.987797:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935576576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787380401.987888:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787380401.987918:0:6578:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8942b0, atime: 0x6a8942b0, ctime: 0x6a8942b0, blocks: 0x1 00010000:00010000:0.0:1787380401.987926:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.987941:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1787380401.987945:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380401.987952:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787380401.988098:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1787380401.988135:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.988169:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.988177:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787380401.988236:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d96b5b14600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d96bd0b0800 00000001:00080000:2.0:1787380401.988310:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1787380401.988317:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787380401.988376:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1787380401.988486:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935576704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787380401.988517:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380401.988548:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935576832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787380401.988570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380401.988954:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787380401.989584:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935576576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1784us (1894us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787380401.989719:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787380401.989744:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935576704 00000100:00100000:0.0:1787380401.989750:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935576704 00000100:00100000:0.0:1787380401.989784:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935576832 00000100:00100000:0.0:1787380401.989786:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935576832 00000100:00100000:0.0:1787380401.989799:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380401.989914:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787380401.989924:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1874203935576832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787380401.990188:0:8465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787380401.990192:0:8465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787380401 00002000:00010000:2.0:1787380401.990194:0:8465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787380401.990196:0:8465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787380401 -> 1787380401 00002000:00010000:2.0:1787380401.990198:0:8465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787380401.990234:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3299:x1874203935576832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 313us (1663us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787380401.990241:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1787380401.990289:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b5219500/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787380401.990294:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935576832:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1787380401.990309:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787380401.990466:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:2.0:1787380401.990499:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b5230000/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787380401.990513:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935576576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787380401.990569:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1874203935576704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787380401.990586:0:6578:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1787380401.990750:0:6578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.990770:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.990779:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787380401.990783:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380401.990788:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.990897:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.990913:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 11 pid: 6578 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380401.990926:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1874203935576960:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380401.991127:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380401.991456:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10524:x1874203915640704:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 Request processed in 51779us (52022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380401.991466:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 124 00010000:00010000:3.0:1787380401.995832:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380401.995847:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.995863:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380401.995868:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.995878:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.995905:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.995911:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000373b1103/0x651a07d118842cbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.995933:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380401.995934:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380401.995936:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380401.996164:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380401.996245:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380401.996273:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915640960 00000100:00100000:1.0:1787380401.996281:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915640960 00010000:00010000:1.0:1787380401.996317:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 12 pid: 6578 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380401.996396:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:1.0:1787380401.996406:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:2356:x1874203915640960:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380401.996419:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380401.996425:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 12 pid: 6578 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.996437:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 12 pid: 6578 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.996457:0:8292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380401.996461:0:8292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380401.996465:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.996474:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380401.996491:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380401.996538:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:2356:x1874203915640960:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 134us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380401.996545:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:3.0:1787380401.996743:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915640832 00000100:00100000:3.0:1787380401.996754:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915640832 00000100:00100000:3.0:1787380401.996788:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:3.0:1787380401.996795:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:2356:x1874203915640832:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787380401.997750:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118842a80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f685a expref: 12 pid: 6578 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380401.997769:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1874203935576960:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380401.997789:0:6578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.997800:0:6578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.997806:0:6578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.997815:0:6578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.997836:0:6578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380401.997854:0:6578:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787380401.998546:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3302:x1874203935576704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8736us (10024us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787380401.998556:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1787380401.999264:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380401.999272:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.999283:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ee00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380401.999288:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.999299:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.999317:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.999324:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d118842cc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380401.999370:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380401.999372:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380401.999373:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787380402.004861:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b521aa00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787380402.004878:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935576704:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787380402.030208:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787380402.030235:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787380402.030501:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915640832:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 Request processed in 33697us (34343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.030512:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:1.0:1787380402.033772:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380402.033850:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915641216 00000100:00100000:3.0:1787380402.033861:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915641216 00000100:00100000:3.0:1787380402.033921:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 125 00000100:00100000:3.0:1787380402.033931:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10524:x1874203915641216:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380402.034174:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380402.034201:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ed expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.034218:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:3.0:1787380402.034222:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380402.034248:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.034259:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.034268:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380402.034589:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000deb2f97c reply state 00000000920562da transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380402.034599:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380402.034700:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:10524:x1874203915641216:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 770us (936us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1787380402.034707:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 125 00010000:00010000:1.0:1787380402.037249:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.037282:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.037289:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.037295:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ca00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380402.037300:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.037307:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.037323:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:1.0:1787380402.037325:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380402.037329:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.037335:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842ccc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380402.039889:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380402.039976:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915641344 00000100:00100000:2.0:1787380402.039986:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915641344 00000100:00100000:2.0:1787380402.040036:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:2.0:1787380402.040046:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915641344:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787380402.040259:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787380402.040263:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787380401 -> 1787380400 00002000:00010000:2.0:1787380402.040265:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787380400 00002000:00010000:2.0:1787380402.040267:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787380401 -> 1787380400 00002000:00010000:2.0:1787380402.040270:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787380402.040359:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915641344:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 290us (454us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787380402.040368:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:0.0:1787380402.045488:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380402.045808:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915641600 00000100:00100000:1.0:1787380402.045817:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915641600 00000100:00100000:1.0:1787380402.045877:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 126 00000100:00100000:1.0:1787380402.045887:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:10524:x1874203915641600:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787380402.045954:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.046098:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.046121:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.046165:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.046179:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 15 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380402.046194:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5abaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935577088:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380402.046275:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380402.049630:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380402.049722:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915641728 00000100:00100000:2.0:1787380402.049732:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915641728 00010000:00010000:2.0:1787380402.049771:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 16 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380402.049809:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:2.0:1787380402.049819:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:2356:x1874203915641728:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380402.049847:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380402.049854:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 16 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.049867:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 16 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.049888:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:2.0:1787380402.049893:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.049902:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.049909:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.049926:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380402.050101:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:2356:x1874203915641728:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 281us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.050108:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 57 00010000:00010000:0.0:1787380402.050225:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118842c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68df expref: 15 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380402.050244:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5abaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935577088:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380402.050263:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050272:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050279:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050309:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050316:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050331:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050392:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380402.050397:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050406:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050415:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:0.0:1787380402.050418:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787380402.050421:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.050426:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118842cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380402.050465:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10524:x1874203915641600:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 Request processed in 4579us (4987us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787380402.050473:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 126 00000100:00100000:2.0:1787380402.053604:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380402.053720:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915641856 00000100:00100000:1.0:1787380402.053730:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915641856 00000100:00100000:1.0:1787380402.053783:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:1.0:1787380402.053793:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915641856:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787380402.053834:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.053853:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.053861:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380402.053865:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380402.053870:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.053922:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.053937:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 7 pid: 6576 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380402.053950:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5abad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935577216:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380402.054148:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380402.057094:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5abad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935577216:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380402.057126:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380402.057781:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380402.058103:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915641984 00000100:00100000:3.0:1787380402.058111:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915641984 00010000:00010000:3.0:1787380402.058145:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 8 pid: 6576 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380402.058199:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:3.0:1787380402.058208:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915641984:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380402.058235:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380402.058257:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 8 pid: 6576 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.058269:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 8 pid: 6576 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.058293:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018cd704d/0x651a07d118842cb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68fb expref: 8 pid: 6576 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.058310:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380402.058314:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380402.058319:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.058328:0:11008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.058448:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380402.058493:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915641984:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 285us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.058501:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 58 00010000:00010000:0.0:1787380402.058769:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058779:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058802:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058818:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058826:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058833:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f200 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380402.058837:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058846:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058858:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.058865:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac2f9072/0x651a07d118842cda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380402.058923:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915641856:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 Request processed in 5131us (5328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.058931:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:2.0:1787380402.063302:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380402.063613:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915642240 00000100:00100000:1.0:1787380402.063623:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915642240 00000100:00100000:1.0:1787380402.063683:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 127 00000100:00100000:1.0:1787380402.063692:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10524:x1874203915642240:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787380402.063783:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.063801:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.063813:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.064027:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.064039:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.064060:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.064093:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.064107:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 15 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380402.064122:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935577344:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380402.064218:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380402.068751:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380402.068860:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935577344:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380402.068894:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380402.068995:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915642368 00000100:00100000:0.0:1787380402.069003:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915642368 00010000:00010000:0.0:1787380402.069040:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 16 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380402.069092:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:0.0:1787380402.069101:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:2356:x1874203915642368:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380402.069116:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380402.069123:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 16 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.069134:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 16 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.069174:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118842c9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68e6 expref: 16 pid: 5788 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.069194:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:0.0:1787380402.069199:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.069208:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.069216:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.069235:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380402.069294:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:2356:x1874203915642368:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 193us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.069302:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 59 00010000:00010000:1.0:1787380402.069545:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.069554:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380402.069739:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787380402.069887:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1787380402.069934:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787380402.070045:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935577472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787380402.070095:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380402.070125:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968a0cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380402.070796:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935577472 00000100:00100000:0.0:1787380402.070811:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935577472 00000100:00100000:0.0:1787380402.070867:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380402.070876:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1874203935577472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787380402.071095:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1874203935577472:12345-0@lo:1000:mdt00_001.0 Request processed in 221us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.071104:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380402.071189:0:5787:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1787380402.071196:0:5787:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1787380402.071213:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b5219500, transno 4294967309 00000100:00100000:3.0:1787380402.071243:0:5787:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d96b521aa00 x1874203935576704/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787380417 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380402.071256:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935577472:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787380402.071780:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1787380402.071844:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935577600:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787380402.071878:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380402.071894:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91300 going to sleep for 11 seconds 00000100:00080000:2.0:1787380402.072130:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380402.072364:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935577600 00000100:00100000:1.0:1787380402.072370:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935577600 00000100:00100000:1.0:1787380402.072401:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380402.072408:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1874203935577600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787380402.072585:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5787:x1874203935577600:12345-0@lo:1000:mdt00_001.0 Request processed in 176us (705us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787380402.072602:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380402.074227:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935577600:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787380402.074269:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074279:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074287:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074292:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380402.074296:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074303:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074319:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d968727fc00) 00010000:00010000:3.0:1787380402.074322:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380402.074327:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074333:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118842ce8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074418:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074424:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074430:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074435:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380402.074438:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074444:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074453:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380402.074455:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380402.074462:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074474:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074482:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.074515:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380402.074543:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935577728:192.168.206.14@tcp:105: 00000100:00100000:3.0:1787380402.074634:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380402.080133:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380402.080329:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935577728:192.168.206.14@tcp:105: 00010000:00010000:1.0:1787380402.080405:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080418:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842c2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080451:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080466:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080477:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080488:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080494:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080501:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080524:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380402.080528:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080536:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080547:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:1.0:1787380402.080550:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380402.080553:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080559:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842cef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080569:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080576:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080582:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080586:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380402.080589:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080608:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080627:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:1.0:1787380402.080630:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380402.080633:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.080638:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380402.080890:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:10524:x1874203915642240:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 17197us (17595us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1787380402.080904:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 127 00000020:00080000:1.0:1787380402.080911:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787380402.081451:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915642496 00000100:00100000:0.0:1787380402.081459:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915642496 00000100:00100000:0.0:1787380402.081505:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:0.0:1787380402.081515:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:10523:x1874203915642496:12345-192.168.206.14@tcp:49:lfs.0 00000100:00100000:0.0:1787380402.081623:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:10523:x1874203915642496:12345-192.168.206.14@tcp:49:lfs.0 Request processed in 109us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.081631:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 31 00000040:00080000:2.0:1787380402.081863:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380402.081868:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380402.082276:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787380402.082283:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380402.085175:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380402.085326:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915642752 00000100:00100000:3.0:1787380402.085369:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915642752 00000100:00100000:3.0:1787380402.085432:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 128 00000100:00100000:3.0:1787380402.085441:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:10523:x1874203915642752:12345-192.168.206.14@tcp:58:lfs.0 00000040:00080000:3.0:1787380402.085821:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787380402.085910:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:10523:x1874203915642752:12345-192.168.206.14@tcp:58:lfs.0 Request processed in 469us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.085918:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 128 00000100:00100000:3.0:1787380402.088085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380402.093579:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915643008 00000100:00100000:0.0:1787380402.093600:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915643008 00000100:00100000:0.0:1787380402.093660:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:0.0:1787380402.093670:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e1b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:10524:x1874203915643008:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787380402.094544:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787380402.094801:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:0.0:1787380402.094848:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.094863:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.094875:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.094894:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.094901:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.094907:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.094934:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787380402.095366:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e1b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:10524:x1874203915643008:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 1669us (7260us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787380402.095376:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 32 00000020:00080000:0.0:1787380402.095382:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787380402.095939:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380402.095947:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.095954:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380402.095958:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.095980:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.095994:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d96991e8900) 00010000:00010000:3.0:1787380402.095996:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787380402.096000:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.096019:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842cf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380402.096037:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380402.096038:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380402.096040:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380402.124229:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380402.124846:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915643136 00000100:00100000:3.0:1787380402.124856:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915643136 00000100:00100000:2.0:1787380402.125115:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 129 00000100:00100000:2.0:1787380402.125127:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:10526:x1874203915643136:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380402.125173:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380402.125194:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842cfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6902 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125255:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125268:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125279:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125293:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125300:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125306:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125614:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125637:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 21 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125644:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125676:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 21 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380402.125691:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 21 pid: 7761 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380402.125704:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935577856:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380402.125789:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd0facc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380402.129071:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935577856:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380402.129099:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380402.129516:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380402.129658:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915643392 00000100:00100000:1.0:1787380402.129666:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915643392 00000100:00100000:1.0:1787380402.129717:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:1.0:1787380402.129726:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:5567:x1874203915643392:12345-192.168.206.14@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787380402.130101:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:5567:x1874203915643392:12345-192.168.206.14@tcp:35:ldlm_bl.0 Request processed in 375us (585us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787380402.130108:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:3.0:1787380402.134334:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380402.135219:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915643520 00000100:00100000:1.0:1787380402.135229:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915643520 00010000:00010000:1.0:1787380402.135270:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 23 pid: 7761 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380402.135313:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:1.0:1787380402.135322:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:2356:x1874203915643520:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380402.138822:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380402.138838:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 23 pid: 7761 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.138855:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 23 pid: 7761 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.138877:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118842c1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68c3 expref: 23 pid: 7761 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.138896:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:1.0:1787380402.138900:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.138909:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.138916:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380402.138942:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380402.139005:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:2356:x1874203915643520:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 3683us (4678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380402.139014:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 60 00010000:00010000:0.0:1787380402.139286:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139295:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380402.139334:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787380402.139367:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380402.139386:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139400:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139409:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139427:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139434:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139439:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380402.139443:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139450:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139460:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:0.0:1787380402.139462:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380402.139466:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139472:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118842d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139483:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139490:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139496:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139501:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380402.139511:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139519:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139527:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d969371ab00) 00010000:00010000:0.0:1787380402.139530:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380402.139532:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139539:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139587:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d118842cfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6902 expref: 22 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139936:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6902 expref: 21 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380402.139944:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:0.0:1787380402.139947:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380402.139949:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3800, rc 0) 00000100:00100000:0.0:1787380402.140001:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10526:x1874203915643136:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 14876us (15781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.140009:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 129 00000100:00100000:0.0:1787380402.426442:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380402.426462:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935577984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380402.426526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.426619:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935577984 00000100:00100000:0.0:1787380402.426626:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935577984 00000100:00100000:0.0:1787380402.426678:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380402.426687:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874203935577984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380402.426708:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787380402.426747:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1874203935577984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.426753:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380402.426800:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935577984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380402.546742:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380402.546784:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380402.546880:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380402.546907:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380402.546933:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380402.547445:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915643904 00000100:00100000:2.0:1787380402.547454:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915643904 00000100:00100000:2.0:1787380402.547498:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915644032 00000100:00100000:2.0:1787380402.547502:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915644032 00000100:00100000:2.0:1787380402.547547:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:2.0:1787380402.547556:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915643904:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380402.547935:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915643904:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 378us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.547944:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:2.0:1787380402.548085:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:2.0:1787380402.548094:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915644032:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380402.548124:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915644032:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 32us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.548131:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:2.0:1787380402.548165:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915644160 00000100:00100000:2.0:1787380402.548169:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915644160 00000100:00100000:2.0:1787380402.548202:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915643776 00000100:00100000:2.0:1787380402.548205:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915643776 00000100:00100000:2.0:1787380402.548221:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 138 00000100:00100000:2.0:1787380402.548226:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915644160:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380402.548252:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915644160:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 26us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.548257:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 138 00000100:00100000:2.0:1787380402.548267:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 139 00000100:00100000:2.0:1787380402.548272:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2353:x1874203915643776:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380402.548293:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2353:x1874203915643776:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 21us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.548298:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 139 00000100:00080000:2.0:1787380402.548321:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380402.548331:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380402.549181:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915643648 00000100:00100000:0.0:1787380402.549189:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915643648 00000100:00100000:0.0:1787380402.549221:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 288 00000100:00100000:0.0:1787380402.549227:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915643648:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380402.549260:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915643648:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 33us (2528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.549266:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 288 00010000:00010000:3.0:1787380402.679641:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380402.842235:0:11954:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380402.842245:0:11954:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380402.842304:0:11954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787380402.842310:0:11954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787380403.127663:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380403.127672:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380403.127708:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787380403.127715:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787380403.127824:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5218380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935578112:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380403.127928:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380403.132783:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5218380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935578112:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380403.133770:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380403.133844:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915644288 00000100:00100000:3.0:1787380403.133853:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915644288 00000100:00100000:3.0:1787380403.133936:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 130 00000100:00100000:3.0:1787380403.133946:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10538:x1874203915644288:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380403.133976:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380403.134128:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10538:x1874203915644288:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 182us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380403.134136:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 130 00000100:00080000:2.0:1787380403.134660:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380403.137413:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380403.137772:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915644544 00000100:00100000:3.0:1787380403.137782:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915644544 00000100:00100000:3.0:1787380403.137846:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 131 00000100:00100000:3.0:1787380403.137856:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:10538:x1874203915644544:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380403.138108:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380403.138141:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842d19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6909 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380403.138242:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380403.138256:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380403.138269:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380403.138280:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787380403.138969:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842d19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6909 expref: 24 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380403.138991:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6909 expref: 23 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380403.139000:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:3.0:1787380403.139003:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380403.139006:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380403.139121:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:10538:x1874203915644544:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1265us (1715us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787380403.139129:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 131 00000100:00100000:1.0:1787380403.153607:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380403.153723:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380403.153873:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915644928 00000100:00100000:2.0:1787380403.153883:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915644928 00000100:00100000:2.0:1787380403.153941:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:2.0:1787380403.153950:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:2356:x1874203915644928:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380403.153963:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380403.153985:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6909 expref: 23 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.154002:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380403.154006:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380403.154060:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:2356:x1874203915644928:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 110us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380403.154068:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:3.0:1787380403.156773:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915644800 00000100:00100000:3.0:1787380403.156787:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915644800 00000100:00100000:2.0:1787380403.158393:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 132 00000100:00100000:2.0:1787380403.158406:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:10538:x1874203915644800:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787380403.158484:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158517:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158528:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158702:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158711:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158717:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158723:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380403.158727:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158735:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158746:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380403.158749:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380403.158753:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380403.158759:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118842d2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380403.158902:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:10538:x1874203915644800:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 497us (5301us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787380403.158916:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 132 00000040:00080000:1.0:1787380403.159135:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380403.159146:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380403.159670:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787380403.159679:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380403.162278:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380403.162381:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915645184 00000100:00100000:0.0:1787380403.162391:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915645184 00000100:00100000:0.0:1787380403.162443:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:0.0:1787380403.162452:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:10538:x1874203915645184:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787380403.162663:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:10538:x1874203915645184:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 211us (393us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787380403.162671:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 34 00010000:00010000:3.0:1787380403.705027:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380404.658669:0:12005:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380404.658679:0:12005:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380404.658724:0:12005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787380404.658729:0:12005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787380404.728629:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380404.824722:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380404.824922:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915645440 00000100:00100000:1.0:1787380404.824931:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915645440 00000100:00100000:1.0:1787380404.825033:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 133 00000100:00100000:1.0:1787380404.825043:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:10559:x1874203915645440:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380404.825075:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380404.825094:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842d35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6910 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380404.825195:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842d3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380404.825208:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380404.825220:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842d3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380404.825229:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787380404.825376:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842d35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6910 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380404.825392:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842d3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6910 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380404.825408:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:1.0:1787380404.825411:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787380404.825414:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f000, rc 0) 00000100:00100000:1.0:1787380404.825603:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:10559:x1874203915645440:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 560us (886us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787380404.825611:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 133 00000100:00100000:1.0:1787380404.837209:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380404.838314:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915645568 00000100:00100000:2.0:1787380404.838324:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915645568 00000100:00100000:2.0:1787380404.838408:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 134 00000100:00100000:2.0:1787380404.838418:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:10559:x1874203915645568:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:2.0:1787380404.838478:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838494:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838505:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838530:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838537:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838544:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838550:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380404.838553:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838561:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838590:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380404.838598:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380404.838602:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.838608:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380404.838683:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:10559:x1874203915645568:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 265us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380404.838692:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 134 00000100:00100000:2.0:1787380404.909790:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380404.909933:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915645696 00000100:00100000:0.0:1787380404.909944:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915645696 00000100:00100000:0.0:1787380404.910017:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:0.0:1787380404.910040:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915645696:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:0.0:1787380404.910057:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380404.910077:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118842d51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6917 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380404.910112:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8942b0, atime: 0x6a8942b0, ctime: 0x6a8942b0, blocks: 0xb 00010000:00010000:0.0:1787380404.910130:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1787380404.910151:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380404.910159:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118842d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6917 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380404.910175:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118842d51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6917 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380404.910187:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1ea00, rc 0) 00000100:00100000:0.0:1787380404.910247:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915645696:12345-192.168.206.14@tcp:101:cat.0 Request processed in 209us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380404.910253:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00080000:2.0:1787380404.910588:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380404.913653:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380404.913795:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915645824 00000100:00100000:0.0:1787380404.913805:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915645824 00002000:00100000:0.0:1787380404.913859:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9d96b5abbb80 x1874203915645824/t0(0) o3->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:210/0 lens 488/0 e 0 to 0 dl 1787380415 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380404.913871:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5abbb80 with x1874203915645824 ext(0->4095) 00002000:00010000:0.0:1787380404.913876:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96b5abbb80 00000100:00100000:0.0:1787380404.913915:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:0.0:1787380404.913923:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915645824:12345-192.168.206.14@tcp:3:cat.0 00000100:00100000:0.0:1787380404.914151:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915645824:12345-192.168.206.14@tcp:3:cat.0 Request processed in 212us (489us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787380404.914159:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00002000:00100000:0.0:1787380404.914166:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9d96b5abbb80 x1874203915645824/t0(0) o3->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:210/0 lens 488/4536 e 0 to 0 dl 1787380415 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380404.914174:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5abbb80 with x1874203915645824 ext(0->4095) 00002000:00010000:0.0:1787380404.914178:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96b5abbb80 00000001:00080000:0.0:1787380405.056493:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787380405.056512:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1787380405.753738:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380406.007738:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935578496:0@lo:400:kworker.0 00000100:00100000:0.0:1787380406.007807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380406.007874:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380406.007881:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935578624:0@lo:400:kworker.0 00000100:00100000:0.0:1787380406.007909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.008040:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935578368:0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.008073:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.008101:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935578880:0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.008121:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.008155:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787380406.008161:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935578240:0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.008188:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.008207:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935578752:0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.008226:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.008257:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935578624 00000100:00100000:3.0:1787380406.008264:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935578624 00000100:00100000:3.0:1787380406.008312:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935578880 00000100:00100000:3.0:1787380406.008315:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935578880 00000100:00100000:3.0:1787380406.008366:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787380406.008375:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1874203935578624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.008429:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3299:x1874203935578624:12345-0@lo:400:kworker.0 Request processed in 54us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380406.008435:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787380406.008451:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787380406.008457:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935578880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.008486:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935578880:12345-0@lo:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380406.008492:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787380406.008514:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935578240 00000100:00100000:3.0:1787380406.008517:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935578240 00000100:00100000:3.0:1787380406.008543:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787380406.008549:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380406.008639:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935578496 00000100:00100000:0.0:1787380406.008643:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935578496 00000100:00100000:0.0:1787380406.008674:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935578368 00000100:00100000:0.0:1787380406.008677:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935578368 00000100:00100000:0.0:1787380406.008690:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935578752 00000100:00100000:0.0:1787380406.008692:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935578752 00000100:00100000:0.0:1787380406.008706:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787380406.008713:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935578496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380406.008745:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935578496:12345-0@lo:400:kworker.0 Request processed in 32us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380406.008751:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787380406.008763:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787380406.008776:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935578368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380406.008805:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935578368:12345-0@lo:400:kworker.0 Request processed in 30us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380406.008811:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787380406.008824:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787380406.008830:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935578752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380406.008856:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935578752:12345-0@lo:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380406.008862:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787380406.009737:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935578624:0@lo:400:kworker.0 00000100:00100000:1.0:1787380406.009751:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935578496:0@lo:400:kworker.0 00000100:00080000:2.0:1787380406.009820:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380406.009825:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380406.009827:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380406.009897:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3302:x1874203935578240:12345-0@lo:400:kworker.0 Request processed in 1346us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380406.009906:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787380406.009949:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aaaa441-7de5-4747-b366-e84ba9a288bb:3302:1874203935578240:0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.009962:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935578752:0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.009978:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935578368:0@lo:400:kworker.0 00000100:00100000:3.0:1787380406.009987:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787380406.009992:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787380406.010005:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b5230000, transno 4294967304 00000100:00100000:3.0:1787380406.010020:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935578880:0@lo:400:kworker.0 00000100:00100000:1.0:1787380406.525099:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935579008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380406.525174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380406.525241:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579008 00000100:00100000:1.0:1787380406.525248:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579008 00000100:00100000:1.0:1787380406.525301:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787380406.525309:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935579008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380406.525356:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380406.525397:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935579008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380406.525404:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787380406.525450:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935579008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380406.775554:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787380407.093652:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:2.0:1787380407.093673:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787380407.093694:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787380407.093710:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d96aaf913c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787380407.093715:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9687c5aa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d96aaf910c0 00000020:00080000:2.0:1787380407.093718:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9687c5a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d96b5171000 00000020:00080000:2.0:1787380407.093733:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787380407.096030:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787380407.096571:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1787380407.096583:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787380407.096589:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1787380407.545022:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380407.545042:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935579136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380407.545103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380407.545218:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579136 00000100:00100000:0.0:1787380407.545226:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579136 00000100:00100000:0.0:1787380407.545274:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787380407.545282:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935579136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380407.545316:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380407.545379:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935579136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380407.545387:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380407.545465:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787380407.545471:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b521aa00, transno 4294967310 00000004:00080000:2.0:1787380407.545487:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1787380407.545511:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935579136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380407.685229:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380407.685326:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380407.685373:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380407.685394:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380407.685418:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380407.685445:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915646464 00000100:00100000:1.0:1787380407.685453:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915646464 00000100:00100000:1.0:1787380407.685550:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915646080 00000100:00100000:1.0:1787380407.685554:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915646080 00000100:00100000:1.0:1787380407.685580:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 143 00000100:00100000:1.0:1787380407.685591:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915646464:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380407.685659:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915646464:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 70us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380407.685668:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 143 00000100:00100000:1.0:1787380407.685685:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 144 00000100:00100000:1.0:1787380407.685691:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2353:x1874203915646080:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380407.685717:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2353:x1874203915646080:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380407.685723:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 144 00000100:00100000:1.0:1787380407.685758:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915646208 00000100:00100000:1.0:1787380407.685762:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915646208 00000100:00100000:1.0:1787380407.685788:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915646336 00000100:00100000:1.0:1787380407.685791:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915646336 00000100:00100000:1.0:1787380407.685811:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:1.0:1787380407.685818:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915646208:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380407.685844:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915646208:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380407.685851:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:1.0:1787380407.685870:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 83 00000100:00100000:1.0:1787380407.685877:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915646336:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380407.685902:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915646336:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380407.685908:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 83 00000100:00080000:1.0:1787380407.685923:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380407.685927:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380407.685929:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380407.687098:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915645952 00000100:00100000:3.0:1787380407.687107:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915645952 00000100:00100000:3.0:1787380407.687155:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 290 00000100:00100000:3.0:1787380407.687164:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915645952:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380407.687220:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915645952:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 57us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380407.687231:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 290 00010000:00010000:3.0:1787380407.801653:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380408.825445:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380409.847701:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380409.866143:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380409.866243:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915646592 00000100:00100000:0.0:1787380409.866258:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915646592 00000100:00100000:0.0:1787380409.866414:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 135 00000100:00100000:0.0:1787380409.866428:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10204:x1874203915646592:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787380409.866580:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10204:x1874203915646592:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 Request processed in 155us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380409.866610:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 135 00000100:00080000:1.0:1787380409.867022:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380409.870246:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380409.870588:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915646848 00000100:00100000:1.0:1787380409.870603:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915646848 00000100:00100000:0.0:1787380409.873273:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:0.0:1787380409.873290:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:10204:x1874203915646848:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787380409.875797:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:10204:x1874203915646848:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 2489us (5537us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787380409.875814:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:3.0:1787380410.153796:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380410.153948:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915646976 00000100:00100000:1.0:1787380410.153960:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915646976 00000100:00100000:1.0:1787380410.154044:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 136 00000100:00100000:1.0:1787380410.154055:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:11012:x1874203915646976:12345-192.168.206.14@tcp:101:lsof.0 00010000:00010000:1.0:1787380410.154076:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380410.154097:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f691e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380410.154170:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380410.154183:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380410.154195:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787380410.154644:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787380410.154680:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787380410.154691:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380410.154794:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380410.154821:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380410.154838:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380410.154846:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:1.0:1787380410.154848:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380410.154852:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:1.0:1787380410.154918:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+6:11012:x1874203915646976:12345-192.168.206.14@tcp:101:lsof.0 Request processed in 865us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380410.154925:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 136 00000040:00080000:2.0:1787380410.359654:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380410.359662:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380410.359938:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787380410.359945:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787380410.871869:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380411.127761:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935579648:0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.127827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380411.127884:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380411.127891:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935579520:0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.127918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380411.127947:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579648 00000100:00100000:0.0:1787380411.127953:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579648 00000100:00100000:0.0:1787380411.128006:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787380411.128014:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935579648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.128061:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935579648:12345-0@lo:400:kworker.0 Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380411.128069:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787380411.128091:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380411.128132:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698ce9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935579648:0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.128159:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579520 00000100:00100000:0.0:1787380411.128163:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579520 00000100:00100000:0.0:1787380411.128211:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787380411.128219:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935579520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.128268:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874203935579520:12345-0@lo:400:kworker.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380411.128282:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1787380411.128301:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380411.128328:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3300:1874203935579520:0@lo:400:kworker.0 00000100:00100000:2.0:1787380411.128486:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935579264:0@lo:400:kworker.0 00000100:00100000:2.0:1787380411.128520:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380411.128555:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcaf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935579776:0@lo:400:kworker.0 00000100:00100000:2.0:1787380411.128579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380411.128597:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787380411.128603:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935579392:0@lo:400:kworker.0 00000100:00100000:2.0:1787380411.128624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380411.128639:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcaf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935579904:0@lo:400:kworker.0 00000100:00100000:2.0:1787380411.128656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380411.128719:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579264 00000100:00100000:0.0:1787380411.128723:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579264 00000100:00100000:0.0:1787380411.128759:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787380411.128765:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935579264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.128801:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935579264:12345-0@lo:400:kworker.0 Request processed in 36us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380411.128807:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787380411.128837:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935579264:0@lo:400:kworker.0 00000100:00100000:1.0:1787380411.129046:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579904 00000100:00100000:1.0:1787380411.129050:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579904 00000100:00100000:1.0:1787380411.129093:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787380411.129100:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935579904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380411.129149:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935579904:12345-0@lo:400:kworker.0 Request processed in 50us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380411.129156:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787380411.129175:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579776 00000100:00100000:1.0:1787380411.129178:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579776 00000100:00100000:1.0:1787380411.129216:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935579392 00000100:00100000:1.0:1787380411.129218:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935579392 00000100:00100000:1.0:1787380411.129236:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787380411.129241:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935579776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380411.129281:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935579776:12345-0@lo:400:kworker.0 Request processed in 40us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380411.129288:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787380411.129302:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787380411.129502:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380411.129506:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380411.129529:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcaf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935579904:0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.129540:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcaf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935579776:0@lo:400:kworker.0 00000100:00100000:1.0:1787380411.129606:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935579392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380411.129655:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935579392:12345-0@lo:400:kworker.0 Request processed in 347us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380411.129662:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787380411.129796:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935579392:0@lo:400:kworker.0 00000100:00100000:0.0:1787380411.641823:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380411.641847:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935580032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380411.641929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380411.642298:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580032 00000100:00100000:1.0:1787380411.642306:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580032 00000100:00100000:1.0:1787380411.642381:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787380411.642391:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935580032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380411.642423:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380411.642466:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935580032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380411.642472:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787380411.644049:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935580032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380411.899438:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787380412.276398:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1787380412.276502:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787380412.276568:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787380412.276580:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787380412.663761:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380412.663783:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcaf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935580160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380412.663849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380412.663970:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580160 00000100:00100000:0.0:1787380412.663978:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580160 00000100:00100000:0.0:1787380412.664043:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787380412.664052:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935580160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380412.664105:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380412.664155:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935580160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380412.664161:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380412.664421:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcaf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935580160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380412.787987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380412.788039:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380412.788091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380412.788122:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380412.788147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380412.788439:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915647104 00000100:00100000:3.0:1787380412.788449:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915647104 00000100:00100000:3.0:1787380412.788511:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 292 00000100:00100000:3.0:1787380412.788521:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915647104:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380412.788595:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915647104:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 75us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380412.788603:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 292 00000100:00100000:0.0:1787380412.789295:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915647616 00000100:00100000:0.0:1787380412.789312:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915647616 00000100:00080000:1.0:1787380412.789394:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380412.789400:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915647232 00000100:00100000:0.0:1787380412.789403:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915647232 00000100:00100000:1.0:1787380412.789423:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 148 00000100:00100000:1.0:1787380412.789567:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:2353:x1874203915647616:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380412.789637:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:2353:x1874203915647616:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 62us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380412.791331:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915647360 00000100:00100000:2.0:1787380412.791367:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915647360 00000100:00100000:2.0:1787380412.791421:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915647488 00000100:00100000:2.0:1787380412.791425:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915647488 00000100:00100000:2.0:1787380412.791457:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 86 00000100:00100000:2.0:1787380412.791467:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915647360:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380412.791534:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915647360:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 68us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380412.791542:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 86 00000100:00100000:2.0:1787380412.791558:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 87 00000100:00100000:2.0:1787380412.791565:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915647488:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380412.791589:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2353:x1874203915647488:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 25us (3441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380412.791595:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 87 00000100:00080000:2.0:1787380412.791640:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380412.791645:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380412.791647:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380412.793785:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 149 00000100:00100000:0.0:1787380412.793808:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2353:x1874203915647232:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380412.793893:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2353:x1874203915647232:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 96us (5769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380412.793902:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 149 00000100:00100000:1.0:1787380412.815780:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 148 00010000:00010000:2.0:1787380412.920821:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380413.945673:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787380414.193803:0:12209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:33:32 (1787380412) 00010000:00010000:2.0:1787380414.970846:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380415.472575:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380415.473215:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915647872 00000100:00100000:0.0:1787380415.473228:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915647872 00000100:00100000:0.0:1787380415.473317:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 137 00000100:00100000:0.0:1787380415.473328:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:11278:x1874203915647872:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380415.473387:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380415.473407:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842d66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6925 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.473488:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.473504:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.473530:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.473546:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.473553:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.473560:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474002:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842d7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474014:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842d7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474023:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842d7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380415.474032:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:2.0:1787380415.474209:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787380415.474770:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474779:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474786:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474793:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380415.474803:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474810:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.474825:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d968727fe00) 00010000:00010000:0.0:1787380415.474828:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380415.474833:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475071:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475098:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475195:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475201:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475207:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380415.475210:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475216:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475225:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d96991e8000) 00010000:00010000:0.0:1787380415.475227:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380415.475238:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475244:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842d74 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475824:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842d66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6925 expref: 16 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475854:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842d7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6925 expref: 15 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380415.475862:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:0.0:1787380415.475865:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380415.475867:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1ee00, rc 0) 00000100:00100000:0.0:1787380415.475960:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:11278:x1874203915647872:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 2633us (3393us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787380415.475969:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 137 00000100:00100000:0.0:1787380415.483430:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380415.483466:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380415.483535:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915648128 00000100:00100000:3.0:1787380415.483545:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915648128 00000100:00100000:1.0:1787380415.483556:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915648000 00000100:00100000:1.0:1787380415.483563:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915648000 00000100:00100000:3.0:1787380415.483608:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 138 00000100:00100000:3.0:1787380415.483621:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:11278:x1874203915648128:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787380415.483623:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:1.0:1787380415.483638:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+16:2356:x1874203915648000:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380415.483653:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380415.483676:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842d7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6925 expref: 16 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380415.483696:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:1.0:1787380415.483701:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380415.483730:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:11278:x1874203915648128:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380415.483731:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:2356:x1874203915648000:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380415.483748:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 138 00000100:00100000:1.0:1787380415.483748:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00010000:00010000:2.0:1787380415.991694:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380416.248046:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935580544:0@lo:400:kworker.0 00000100:00100000:2.0:1787380416.248074:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935580416:0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.248159:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935580288:0@lo:400:kworker.0 00000100:00100000:2.0:1787380416.249831:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380416.249928:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935580928:0@lo:400:kworker.0 00000100:00100000:2.0:1787380416.250264:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380416.250357:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580928 00000100:00100000:2.0:1787380416.250366:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580928 00000100:00100000:2.0:1787380416.250446:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787380416.250458:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935580928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380416.250539:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935580928:12345-0@lo:400:kworker.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380416.250547:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787380416.250574:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380416.250613:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935580928:0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.250815:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380416.250863:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd0a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935580800:0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.250896:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380416.250937:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580416 00000100:00100000:0.0:1787380416.250943:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580416 00000100:00100000:0.0:1787380416.250981:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580800 00000100:00100000:0.0:1787380416.250984:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580800 00000100:00100000:0.0:1787380416.251009:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787380416.251027:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935580416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.251074:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935580416:12345-0@lo:400:kworker.0 Request processed in 49us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380416.251094:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787380416.251109:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787380416.251116:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935580800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.251143:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935580800:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380416.251148:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1787380416.251169:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380416.251189:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b52dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935580416:0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.251214:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd0a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935580800:0@lo:400:kworker.0 00000100:00100000:3.0:1787380416.251308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380416.251358:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380416.251369:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd0a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935580672:0@lo:400:kworker.0 00000100:00100000:3.0:1787380416.251398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380416.251553:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580544 00000100:00100000:0.0:1787380416.251557:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580544 00000100:00100000:0.0:1787380416.251591:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787380416.251597:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935580544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.251634:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935580544:12345-0@lo:400:kworker.0 Request processed in 36us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380416.251640:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1787380416.251794:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380416.251819:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935580544:0@lo:400:kworker.0 00000100:00100000:2.0:1787380416.251893:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580288 00000100:00100000:2.0:1787380416.251898:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580288 00000100:00100000:2.0:1787380416.251931:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787380416.251937:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935580288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380416.251996:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3301:x1874203935580288:12345-0@lo:400:kworker.0 Request processed in 43us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380416.252002:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1787380416.252030:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935580672 00000100:00100000:2.0:1787380416.252033:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935580672 00000100:00100000:2.0:1787380416.252060:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787380416.252066:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935580672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380416.252110:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935580672:12345-0@lo:400:kworker.0 Request processed in 43us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380416.252116:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1787380416.252260:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380416.252281:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd0a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935580672:0@lo:400:kworker.0 00000100:00100000:0.0:1787380416.252479:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935580288:0@lo:400:kworker.0 00000040:00080000:1.0:1787380416.513990:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380416.514003:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380416.514045:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787380416.514052:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380416.764022:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380416.764061:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935581056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380416.764180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380416.764276:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935581056 00000100:00100000:3.0:1787380416.764285:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935581056 00000100:00100000:3.0:1787380416.764377:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380416.764389:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935581056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380416.764715:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380416.764769:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935581056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 382us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380416.764779:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380416.764840:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935581056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380417.015613:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787380417.364065:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:2.0:1787380417.787658:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380417.787689:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935581184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380417.787778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380417.790759:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935581184 00000100:00100000:0.0:1787380417.790779:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935581184 00000100:00100000:0.0:1787380417.790857:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787380417.790869:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96afdb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935581184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380417.790921:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380417.791035:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96afdb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935581184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380417.791043:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787380417.791519:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935581184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380417.894444:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380417.894550:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915648256 00000100:00100000:0.0:1787380417.894564:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915648256 00000100:00100000:0.0:1787380417.894660:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 139 00000100:00100000:0.0:1787380417.894671:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:11320:x1874203915648256:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380417.894697:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380417.894723:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842d89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f692c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.894804:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.894821:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.894836:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.894852:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.894858:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.894864:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895224:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895256:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895263:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895269:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380417.895274:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895282:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895297:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:0.0:1787380417.895300:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380417.895306:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895312:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842d90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895326:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895333:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895368:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895374:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380417.895383:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895391:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895399:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d96991e8000) 00010000:00010000:0.0:1787380417.895402:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380417.895405:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895412:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842d97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895453:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842d89 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f692c expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895463:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:0.0:1787380417.895466:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380417.895469:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842d89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f692c expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.895479:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1fe00, rc 0) 00000100:00100000:0.0:1787380417.895554:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:11320:x1874203915648256:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 884us (1122us total) trans 0 rc 301/301 00000100:00100000:0.0:1787380417.895564:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 139 00000100:00080000:3.0:1787380417.895768:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380417.907246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380417.907325:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380417.907393:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380417.907429:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915648896 00000100:00100000:3.0:1787380417.907441:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915648896 00000100:00100000:3.0:1787380417.907521:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 90 00000100:00100000:3.0:1787380417.907535:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915648896:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380417.907620:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915648896:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380417.907627:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 90 00000100:00080000:3.0:1787380417.907767:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380417.907852:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915648512 00000100:00100000:1.0:1787380417.907858:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915648512 00000100:00100000:1.0:1787380417.907908:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 140 00000100:00100000:1.0:1787380417.907916:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:11320:x1874203915648512:12345-192.168.206.14@tcp:36:lfs.0 00010000:00010000:1.0:1787380417.907997:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380417.908031:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55400/0x651a07d118842707 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6765 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380417.908055:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:1.0:1787380417.908061:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380417.908433:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380417.908449:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 5 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380417.908459:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380417.908496:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 5 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380417.909324:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 5 pid: 5786 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380417.909374:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935581312:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380417.909481:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380417.909831:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915648640 00000100:00100000:1.0:1787380417.909842:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915648640 00000100:00100000:1.0:1787380417.909902:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 294 00000100:00100000:1.0:1787380417.909913:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915648640:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380417.909966:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915648640:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 55us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380417.909988:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 294 00000100:00100000:0.0:1787380417.919095:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380417.919148:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380417.919203:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915649024 00000100:00100000:3.0:1787380417.919216:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915649024 00000100:00100000:0.0:1787380417.919273:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380417.919302:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915649152 00000100:00100000:0.0:1787380417.919333:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915649152 00010000:00010000:0.0:1787380417.919390:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 7 pid: 5786 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380417.919432:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:0.0:1787380417.919444:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95d22c36-51bc-485d-88b7-d90632ec1801+7:2356:x1874203915649152:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380417.919462:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380417.919470:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 7 pid: 5786 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919485:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 7 pid: 5786 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919513:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:0.0:1787380417.919519:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919529:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919539:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919564:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380417.919630:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:95d22c36-51bc-485d-88b7-d90632ec1801+7:2356:x1874203915649152:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 187us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380417.919638:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00010000:00010000:0.0:1787380417.919701:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842d5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f691e expref: 6 pid: 5786 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380417.919731:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935581312:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380417.919762:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919773:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919780:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919811:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919823:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.919834:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380417.920321:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 153 00000100:00100000:3.0:1787380417.920353:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915649024:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380417.920424:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:2353:x1874203915649024:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 93us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380417.920434:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 153 00000100:00080000:3.0:1787380417.920464:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380417.921009:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915648768 00000100:00100000:1.0:1787380417.921018:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915648768 00000100:00100000:1.0:1787380417.921065:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 91 00000100:00100000:1.0:1787380417.921084:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915648768:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380417.921132:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2353:x1874203915648768:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 49us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380417.921138:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 91 00000100:00080000:3.0:1787380417.921487:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00200000:0.0:1787380417.924479:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787380417.924502:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.924515:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.924523:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.924530:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380417.924541:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.924550:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.924570:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727f100) 00010000:00010000:0.0:1787380417.924573:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380417.924577:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380417.924583:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842d9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380417.924604:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ec475c1 reply state 00000000052452d6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380417.924614:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787380417.927196:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380417.927239:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380417.927247:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380417.927254:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380417.927259:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380417.927267:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380417.927286:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d96991e8500) 00010000:00010000:2.0:1787380417.927290:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380417.927296:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380417.927304:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842da5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380417.931371:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:11320:x1874203915648512:12345-192.168.206.14@tcp:36:lfs.0 Request processed in 16806us (17489us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787380417.931390:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 140 00000100:00100000:1.0:1787380418.038744:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.038853:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915649280 00000100:00100000:3.0:1787380418.038865:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915649280 00000100:00100000:3.0:1787380418.038953:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 141 00000100:00100000:3.0:1787380418.038965:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:11328:x1874203915649280:12345-192.168.206.14@tcp:101:lctl.0 00010000:00010000:3.0:1787380418.038997:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380418.039027:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842dac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6933 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.039121:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842db3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.039136:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.039149:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380418.039228:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787380418.039233:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380418.039260:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.039301:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842dac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6933 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.039401:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842db3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6933 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.039411:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:3.0:1787380418.039414:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380418.039418:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c000, rc 0) 00000100:00100000:3.0:1787380418.039493:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:11328:x1874203915649280:12345-192.168.206.14@tcp:101:lctl.0 Request processed in 530us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380418.039515:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 141 00010000:00010000:3.0:1787380418.044652:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380418.102712:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380418.102810:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915649408 00000100:00100000:1.0:1787380418.102823:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915649408 00000100:00100000:1.0:1787380418.102903:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 142 00000100:00100000:1.0:1787380418.102916:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:11334:x1874203915649408:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380418.102943:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380418.102968:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118842dba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f693a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103052:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103078:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103092:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103108:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103133:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103140:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103287:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103296:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103302:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380418.103393:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787380418.103397:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380418.103426:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103439:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103447:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103453:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103460:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fa00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380418.103464:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103479:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103493:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:1.0:1787380418.103496:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380418.103501:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103589:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842dc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103606:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103612:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103619:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103625:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380418.103628:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103634:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103641:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d968911da00) 00010000:00010000:1.0:1787380418.103644:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380418.103647:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103662:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842dc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103704:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118842dba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f693a expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103717:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f693a expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.103726:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380418.103728:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787380418.103731:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e800, rc 0) 00000100:00100000:1.0:1787380418.103810:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:11334:x1874203915649408:12345-192.168.206.14@tcp:101:bash.0 Request processed in 896us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380418.103819:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 142 00000100:00100000:2.0:1787380418.107147:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.107245:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915649664 00000100:00100000:3.0:1787380418.107256:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915649664 00000100:00100000:3.0:1787380418.107369:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 143 00000100:00100000:3.0:1787380418.107619:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+15:11334:x1874203915649664:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380418.107808:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380418.107838:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842dd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6941 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.108010:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.108029:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.108059:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.111957:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.111981:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.111994:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380418.112885:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787380418.113058:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113085:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113094:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113130:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113137:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113142:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113148:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380418.113233:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113246:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113395:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380418.113399:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380418.113404:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113411:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842ddd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380418.113435:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003dedfd92 reply state 00000000d657bbc9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380418.113443:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787380418.113480:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842dd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113494:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.113500:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371a800) 00010000:00010000:2.0:1787380418.113503:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380418.113505:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3a00, rc 0) 00000100:00100000:2.0:1787380418.113585:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11334:x1874203915649664:12345-192.168.206.14@tcp:101:bash.0 Request processed in 6206us (6450us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787380418.113593:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 143 00000100:00100000:2.0:1787380418.116693:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:1.0:1787380418.116797:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.116810:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.116817:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.116824:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380418.116828:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.116836:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.116865:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d969371a900) 00010000:00010000:1.0:1787380418.116869:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380418.116873:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.116880:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118842de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380418.117054:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915649792 00000100:00100000:3.0:1787380418.117078:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915649792 00000100:00100000:3.0:1787380418.117255:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:3.0:1787380418.117274:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915649792:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380418.117301:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380418.117330:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6948 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380418.117388:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380418.117411:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1787380418.117426:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380418.117436:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.117455:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.117468:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d800, rc 0) 00000100:00100000:3.0:1787380418.117557:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2354:x1874203915649792:12345-192.168.206.14@tcp:101:bash.0 Request processed in 288us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380418.124780:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:0.0:1787380418.127697:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380418.127820:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915649920 00000100:00100000:1.0:1787380418.127833:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915649920 00000100:00100000:1.0:1787380418.127937:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:1.0:1787380418.127949:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:11334:x1874203915649920:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380418.127973:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380418.127998:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f694f expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.128040:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.128050:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380418.128055:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380418.128061:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.128124:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.128383:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 7 pid: 8465 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380418.128401:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1874203935581440:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380418.128582:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380418.132398:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1874203935581440:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380418.132441:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.132469:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fc00, rc 0) 00000100:00100000:1.0:1787380418.132639:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:11334:x1874203915649920:12345-192.168.206.14@tcp:101:bash.0 Request processed in 4690us (4954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380418.132650:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:3.0:1787380418.135777:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380418.135975:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915650048 00000100:00100000:2.0:1787380418.135987:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915650048 00010000:00010000:2.0:1787380418.136038:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 7 pid: 8465 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380418.136398:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:2.0:1787380418.136411:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915650048:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380418.136430:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380418.136457:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 7 pid: 8465 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.136473:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 7 pid: 8465 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.136499:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118842df9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6948 expref: 7 pid: 8465 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.136532:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380418.136537:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380418.136547:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.136560:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.136607:0:5773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380418.136642:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585f0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5773:1874203935581568:192.168.206.14@tcp:105: 00000100:00100000:2.0:1787380418.136754:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380418.141203:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.141300:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915650304 00000100:00100000:3.0:1787380418.141311:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915650304 00000100:00100000:3.0:1787380418.141403:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:3.0:1787380418.141414:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:11334:x1874203915650304:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:3.0:1787380418.141869:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11334:x1874203915650304:12345-192.168.206.14@tcp:35:bash.0 Request processed in 455us (677us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1787380418.141878:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:2.0:1787380418.143571:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585f0d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5773:1874203935581568:192.168.206.14@tcp:105: 00010000:00010000:2.0:1787380418.143606:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380418.143725:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915650048:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 7316us (7960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380418.143739:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:0.0:1787380418.267780:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380418.267884:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915650560 00000100:00100000:1.0:1787380418.267897:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915650560 00000100:00100000:1.0:1787380418.267971:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 144 00000100:00100000:1.0:1787380418.267983:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11344:x1874203915650560:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380418.268012:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380418.268037:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842e07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6956 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380418.268198:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787380418.268740:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842e07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6956 expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.268782:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:1.0:1787380418.268785:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380418.268792:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118842e07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6956 expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.268809:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e400, rc 0) 00000100:00100000:1.0:1787380418.268934:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:11344:x1874203915650560:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 952us (1165us total) trans 4294967420 rc 301/301 00000100:00100000:1.0:1787380418.268942:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 144 00000100:00100000:0.0:1787380418.280822:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.280975:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915650816 00000100:00100000:3.0:1787380418.280987:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915650816 00000100:00100000:3.0:1787380418.281056:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:3.0:1787380418.281078:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:11344:x1874203915650816:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:3.0:1787380418.281651:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:11344:x1874203915650816:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 583us (842us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787380418.281661:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:3.0:1787380418.351323:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.351602:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915650944 00000100:00100000:0.0:1787380418.351615:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915650944 00000100:00100000:0.0:1787380418.351695:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 145 00000100:00100000:0.0:1787380418.351707:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:11350:x1874203915650944:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380418.351740:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380418.351794:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f695d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.352023:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118842e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.352041:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118842e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.352055:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118842e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380418.352144:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787380418.352148:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380418.352176:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118842e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.352207:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f695d expref: 22 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.352228:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118842e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f695d expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.352238:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:0.0:1787380418.352241:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380418.352245:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e400, rc 0) 00000100:00100000:0.0:1787380418.352327:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:11350:x1874203915650944:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 622us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380418.353760:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 145 00000100:00100000:1.0:1787380418.366416:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.366804:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915651200 00000100:00100000:0.0:1787380418.366833:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915651200 00000100:00100000:0.0:1787380418.366927:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 146 00000100:00100000:0.0:1787380418.366940:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:11350:x1874203915651200:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380418.366968:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380418.366994:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6964 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.367141:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.367157:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.367170:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380418.367184:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787380418.367387:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6964 expref: 24 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.367408:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6964 expref: 23 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.367417:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371a800) 00010000:00010000:0.0:1787380418.367420:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380418.367424:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1ee00, rc 0) 00000100:00100000:0.0:1787380418.367506:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:11350:x1874203915651200:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 569us (1103us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787380418.367515:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 146 00000100:00100000:1.0:1787380418.371760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380418.371871:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915651456 00000100:00100000:2.0:1787380418.371884:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915651456 00000100:00100000:2.0:1787380418.371959:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 147 00000100:00100000:2.0:1787380418.371971:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:11350:x1874203915651456:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380418.372001:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380418.372025:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f696b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.372158:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842e3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.372175:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.372189:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842e3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380418.372205:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787380418.372439:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f696b expref: 26 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380418.372477:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:2.0:1787380418.372486:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f696b expref: 25 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.372497:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371a800) 00010000:00010000:2.0:1787380418.372501:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380418.372505:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2800, rc 0) 00000100:00100000:2.0:1787380418.372585:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+25:11350:x1874203915651456:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 616us (838us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787380418.372593:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 147 00000100:00100000:3.0:1787380418.372981:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915651584 00000100:00100000:3.0:1787380418.372988:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915651584 00000100:00100000:3.0:1787380418.373041:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1787380418.373051:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+25:2356:x1874203915651584:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380418.373074:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380418.373096:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6964 expref: 25 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.373110:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371a800) 00010000:00010000:3.0:1787380418.373115:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380418.373160:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:2356:x1874203915651584:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 111us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380418.373167:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:1.0:1787380418.382923:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380418.383030:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915651712 00000100:00100000:2.0:1787380418.383043:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915651712 00000100:00100000:2.0:1787380418.383128:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:2.0:1787380418.383141:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915651712:12345-192.168.206.14@tcp:1:lfs.0 00010000:00010000:2.0:1787380418.383200:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.383224:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.383234:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380418.383239:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380418.383244:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.383293:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.383323:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 6 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380418.383389:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585f0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1874203935581696:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380418.383509:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380418.388935:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.389808:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915651840 00000100:00100000:0.0:1787380418.389823:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915651840 00002000:00100000:0.0:1787380418.389895:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d96b5116a00 x1874203915651840/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:224/0 lens 504/0 e 0 to 0 dl 1787380429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380418.389908:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5116a00 with x1874203915651840 ext(0->12) 00010000:00010000:0.0:1787380418.389920:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 7 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.389940:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 7 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380418.389949:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96b5116a00 00000100:00100000:0.0:1787380418.389992:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:0.0:1787380418.390003:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915651840:12345-192.168.206.14@tcp:4:lfs.0 00000100:00100000:0.0:1787380418.390867:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915651840:12345-192.168.206.14@tcp:4:lfs.0 Request processed in 858us (1938us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787380418.390879:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00002000:00100000:0.0:1787380418.390888:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d96b5116a00 x1874203915651840/t4294967305(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:224/0 lens 504/448 e 0 to 0 dl 1787380429 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380418.390897:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5116a00 with x1874203915651840 ext(0->12) 00010000:00010000:0.0:1787380418.390905:0:6584:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 9 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.390922:0:6584:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 9 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380418.390942:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96b5116a00 00000100:00100000:2.0:1787380418.393247:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585f0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1874203935581696:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380418.395487:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380418.396213:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.396502:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915651968 00000100:00100000:0.0:1787380418.396515:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915651968 00010000:00010000:0.0:1787380418.396570:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 9 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380418.396652:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:0.0:1787380418.396663:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2354:x1874203915651968:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380418.396692:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787380418.396718:0:5771:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787380418.396722:0:5771:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787380417 00002000:00010000:0.0:1787380418.396725:0:5771:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787380418 00002000:00010000:0.0:1787380418.396727:0:5771:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787380417 00010000:00010000:0.0:1787380418.396735:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 9 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.396750:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 9 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.396788:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002322277f/0x651a07d118842e00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f694f expref: 9 pid: 6578 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.396810:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380418.396815:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380418.396822:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.396852:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.396893:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380418.396972:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2354:x1874203915651968:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 310us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380418.396981:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 63 00010000:00010000:2.0:1787380418.397054:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397073:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397105:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397115:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397124:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397145:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380418.397150:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397161:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397176:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.397185:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe517633/0x651a07d118842e4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380418.397242:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915651712:12345-192.168.206.14@tcp:1:lfs.0 Request processed in 14104us (14335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380418.397252:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:1.0:1787380418.401151:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.401307:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915652224 00000100:00100000:3.0:1787380418.401319:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915652224 00000100:00100000:2.0:1787380418.401902:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:2.0:1787380418.401919:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f138450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:11350:x1874203915652224:12345-192.168.206.14@tcp:35:lfs.0 00000004:00010000:2.0:1787380418.402007:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842e3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f696b expref: 24 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380418.402388:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787380418.402441:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787380418.403295:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1787380418.403406:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.403436:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 28 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.403446:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.403491:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 28 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.403509:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 28 pid: 5788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380418.403525:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585f0d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1874203935581824:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380418.403894:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380418.408592:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380418.408781:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585f0d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1874203935581824:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380418.408816:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380418.409223:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915652352 00000100:00100000:0.0:1787380418.409232:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915652352 00010000:00010000:0.0:1787380418.409280:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 29 pid: 5788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380418.409323:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:0.0:1787380418.409332:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:2355:x1874203915652352:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380418.409365:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380418.409372:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 29 pid: 5788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.409384:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 29 pid: 5788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.409409:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118842deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6941 expref: 29 pid: 5788 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.409426:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371a800) 00010000:00010000:0.0:1787380418.409447:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.409457:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.409464:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.409496:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380418.409557:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c50050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:2355:x1874203915652352:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 225us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380418.409564:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 64 00010000:00010000:3.0:1787380418.410229:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.410242:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380418.410442:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1787380418.410729:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787380418.410864:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bceeb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935581952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787380418.410937:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380418.410978:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380418.411443:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935581952 00000100:00100000:0.0:1787380418.411453:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935581952 00000100:00100000:0.0:1787380418.411531:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380418.411542:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1874203935581952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380418.411668:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1874203935581952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380418.411957:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787380418.412106:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380418.412176:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bceeb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935581952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787380418.413223:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1787380418.413325:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bceeb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935582080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787380418.414591:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380418.414645:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380418.414774:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935582080 00000100:00100000:0.0:1787380418.414784:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935582080 00000100:00100000:0.0:1787380418.414852:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380418.414863:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5789:x1874203935582080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380418.415151:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1874203935582080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 289us (565us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787380418.415160:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380418.415319:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bceeb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935582080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787380418.415434:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787380418.415492:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.415505:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.415534:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.415541:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380418.415546:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.415556:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.415575:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371a800) 00010000:00010000:2.0:1787380418.415579:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787380418.415585:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380418.415591:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842e54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380418.415904:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787380418.416035:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787380418.416198:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368727858919ns, next at 369727855158ns, rc = 0 00000001:00080000:2.0:1787380418.416208:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787380418.416250:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371a800) 00010000:00010000:2.0:1787380418.416254:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380418.416262:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118842e3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f696b expref: 32 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380418.416422:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f138450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:11350:x1874203915652224:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 14508us (15284us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787380418.416448:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 38 00000020:00080000:2.0:1787380418.416454:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787380418.419806:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.419889:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915652480 00000100:00100000:0.0:1787380418.419902:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915652480 00000100:00100000:0.0:1787380418.420077:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 148 00000100:00100000:0.0:1787380418.420090:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:11350:x1874203915652480:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380418.420125:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380418.420156:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6972 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.420236:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6972 expref: 32 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.420253:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6972 expref: 32 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.420276:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380418.420280:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380418.420284:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e600, rc 0) 00000100:00100000:0.0:1787380418.420391:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:11350:x1874203915652480:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 302us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380418.420399:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 148 00000100:00100000:0.0:1787380418.424227:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380418.424332:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915652736 00000100:00100000:2.0:1787380418.424665:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915652736 00000100:00100000:2.0:1787380418.424772:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:2.0:1787380418.424784:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:11350:x1874203915652736:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:2.0:1787380418.425104:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:11350:x1874203915652736:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 321us (889us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1787380418.425113:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:2.0:1787380418.558908:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.559023:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915652992 00000100:00100000:0.0:1787380418.559036:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915652992 00000100:00100000:0.0:1787380418.559129:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 149 00000100:00100000:0.0:1787380418.559141:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+33:11360:x1874203915652992:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380418.559172:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380418.559200:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842e62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6979 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380418.559412:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787380418.559574:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842e62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6979 expref: 35 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.559592:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:0.0:1787380418.559596:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380418.559602:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842e62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6979 expref: 35 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.559618:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380418.559704:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11360:x1874203915652992:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 565us (808us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1787380418.559713:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 149 00000100:00100000:1.0:1787380418.563681:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.563787:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915653120 00000100:00100000:3.0:1787380418.563801:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915653120 00000100:00100000:3.0:1787380418.563921:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 150 00000100:00100000:3.0:1787380418.563933:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11360:x1874203915653120:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:3.0:1787380418.564040:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564062:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564087:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564107:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564115:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564122:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564253:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564262:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564304:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380418.564423:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564439:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564445:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564453:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564459:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ce00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380418.564463:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564472:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564486:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:3.0:1787380418.564489:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380418.564494:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564500:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564518:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564530:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564536:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564542:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380418.564545:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564551:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564559:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968727f900) 00010000:00010000:3.0:1787380418.564562:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380418.564565:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564571:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842e77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564588:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564594:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564600:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564605:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380418.564616:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564622:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564629:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:3.0:1787380418.564632:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380418.564635:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.564641:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380418.564739:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11360:x1874203915653120:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 807us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380418.564750:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 150 00000100:00100000:1.0:1787380418.567994:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380418.568140:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915653376 00000100:00100000:2.0:1787380418.568153:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915653376 00000100:00100000:2.0:1787380418.568262:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:2.0:1787380418.568285:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11360:x1874203915653376:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:2.0:1787380418.568855:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:11360:x1874203915653376:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 571us (873us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787380418.568866:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:2.0:1787380418.605334:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.605494:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915653632 00000100:00100000:0.0:1787380418.605520:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915653632 00000100:00100000:0.0:1787380418.605606:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 151 00000100:00100000:0.0:1787380418.605619:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:11363:x1874203915653632:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380418.605650:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380418.605687:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842e85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6980 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.605790:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.605808:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.605841:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.605859:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.605866:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.605872:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606027:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606036:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606043:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380418.606054:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787380418.606182:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606190:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606197:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606203:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380418.606215:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606223:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606238:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:0.0:1787380418.606241:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380418.606247:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606254:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842e8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606270:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606277:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606283:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606289:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380418.606292:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606298:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606306:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380418.606308:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380418.606318:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606324:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606437:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842e85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606452:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.606459:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380418.606462:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380418.606465:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f600, rc 0) 00000100:00100000:0.0:1787380418.606551:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:11363:x1874203915653632:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 935us (1231us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787380418.606559:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 151 00000100:00100000:1.0:1787380418.611025:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.611123:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915653760 00000100:00100000:3.0:1787380418.611136:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915653760 00000100:00100000:3.0:1787380418.611216:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 152 00000100:00100000:3.0:1787380418.611227:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:11363:x1874203915653760:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:3.0:1787380418.611324:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611372:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611388:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611422:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611447:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611455:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611461:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380418.611467:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611475:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611492:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:3.0:1787380418.611495:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380418.611511:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.611518:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380418.611623:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:11363:x1874203915653760:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 396us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380418.611631:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 152 00000100:00100000:2.0:1787380418.615165:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.615215:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915654016 00000100:00100000:3.0:1787380418.615227:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915654016 00000100:00100000:3.0:1787380418.615297:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:3.0:1787380418.615309:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:11363:x1874203915654016:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:3.0:1787380418.615936:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:11363:x1874203915654016:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 626us (778us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787380418.615964:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:2.0:1787380418.920966:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380418.921114:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915654272 00000100:00100000:0.0:1787380418.921123:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915654272 00000100:00100000:0.0:1787380418.921192:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 153 00000100:00100000:0.0:1787380418.921202:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:11394:x1874203915654272:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:0.0:1787380418.921224:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380418.921243:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842eaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6987 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.921368:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.921571:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380418.921585:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380418.921599:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787380418.921892:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6987 expref: 41 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.921927:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6987 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380418.921939:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380418.921956:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380418.921961:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f400, rc 0) 00000100:00100000:1.0:1787380418.922038:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11394:x1874203915654272:12345-192.168.206.14@tcp:101:cat.0 Request processed in 837us (1080us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787380418.922048:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 153 00000100:00100000:1.0:1787380418.925964:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380418.926013:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380418.926093:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915654528 00000100:00100000:2.0:1787380418.926108:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915654528 00000100:00100000:2.0:1787380418.926199:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:2.0:1787380418.926211:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11394:x1874203915654528:12345-192.168.206.14@tcp:35:cat.0 00000100:00100000:3.0:1787380418.926371:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915654656 00000100:00100000:3.0:1787380418.926382:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915654656 00000100:00100000:3.0:1787380418.926444:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1787380418.926453:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:2354:x1874203915654656:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380418.926468:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380418.926497:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6987 expref: 41 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.926531:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:3.0:1787380418.926536:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380418.926614:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:2354:x1874203915654656:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 160us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380418.926623:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:2.0:1787380418.926812:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11394:x1874203915654528:12345-192.168.206.14@tcp:35:cat.0 Request processed in 598us (859us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787380418.926822:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:2.0:1787380418.997465:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380418.997799:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915654912 00000100:00100000:3.0:1787380418.997809:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915654912 00000100:00100000:3.0:1787380418.997864:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 154 00000100:00100000:3.0:1787380418.997873:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11400:x1874203915654912:12345-192.168.206.14@tcp:101:dd.0 00010000:00010000:3.0:1787380418.997896:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380418.997899:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787380418.997923:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118842e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f695d expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.997942:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:3.0:1787380418.997947:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380418.997960:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ec4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f698e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.998060:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.998088:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.998096:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.998128:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 40 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380418.998142:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 40 pid: 5788 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380418.998155:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bceeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935582208:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380418.998248:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf9ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380419.001736:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380419.001829:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915655040 00000100:00100000:2.0:1787380419.001844:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915655040 00000100:00100000:0.0:1787380419.001854:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bceeb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935582208:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380419.001894:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.001910:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 41 pid: 5788 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787380419.001937:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380419.001956:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:2.0:1787380419.001971:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:2356:x1874203915655040:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380419.002000:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380419.002007:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 41 pid: 5788 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.002019:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 41 pid: 5788 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.002040:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d118842e9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6980 expref: 41 pid: 5788 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.002056:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:2.0:1787380419.002074:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.002084:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.002108:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.002138:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380419.002195:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:2356:x1874203915655040:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 229us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380419.002202:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 65 00010000:00010000:0.0:1787380419.002844:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.002858:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380419.002884:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787380419.003100:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d118842ec4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 41 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.003122:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 40 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.003131:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380419.003133:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787380419.003137:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c800, rc 0) 00000100:00100000:0.0:1787380419.003230:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11400:x1874203915654912:12345-192.168.206.14@tcp:101:dd.0 Request processed in 5357us (5773us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787380419.003240:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 154 00000100:00100000:0.0:1787380419.006653:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380419.006738:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915655296 00000100:00100000:3.0:1787380419.006751:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915655296 00000100:00100000:3.0:1787380419.006973:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 155 00000100:00100000:3.0:1787380419.006987:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11400:x1874203915655296:12345-192.168.206.14@tcp:36:dd.0 00010000:00010000:3.0:1787380419.007401:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380419.007422:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380419.007437:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380419.007509:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1787380419.007537:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb6faddb reply state 00000000afaa26ac transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380419.007548:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380419.007662:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:11400:x1874203915655296:12345-192.168.206.14@tcp:36:dd.0 Request processed in 677us (1023us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787380419.007670:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 155 00000020:00080000:3.0:1787380419.007676:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787380419.009483:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.009500:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.009506:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.009512:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ce00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380419.009516:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.009523:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.009539:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:2.0:1787380419.009542:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380419.009546:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.009552:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118842ed9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.066478:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380419.260288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.260430:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915655424 00000100:00100000:1.0:1787380419.260443:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915655424 00000100:00100000:1.0:1787380419.260537:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 156 00000100:00100000:1.0:1787380419.260550:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+42:11414:x1874203915655424:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:1.0:1787380419.260583:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380419.260612:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842ee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6995 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260708:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260726:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260740:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260757:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260764:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260809:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260938:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260951:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.260961:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.261002:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.261220:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 43 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380419.261238:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935582336:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380419.261409:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380419.266785:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380419.266817:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935582336:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380419.266856:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380419.266920:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915655680 00000100:00100000:3.0:1787380419.266930:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915655680 00000100:00100000:3.0:1787380419.267082:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:3.0:1787380419.267093:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+44:5568:x1874203915655680:12345-192.168.206.14@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787380419.267612:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:5568:x1874203915655680:12345-192.168.206.14@tcp:35:ldlm_bl.0 Request processed in 518us (839us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1787380419.267622:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:2.0:1787380419.276600:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380419.277192:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915655808 00000100:00100000:0.0:1787380419.277203:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915655808 00010000:00010000:0.0:1787380419.277244:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 45 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.277283:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:0.0:1787380419.277293:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:2356:x1874203915655808:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380419.277307:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380419.277314:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 45 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.277328:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 45 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.277392:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d118842ecb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f698e expref: 45 pid: 5787 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.277413:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380419.277432:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.279121:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.279131:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.279178:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380419.279253:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+44:2356:x1874203915655808:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 1958us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380419.279272:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 66 00010000:00010000:2.0:1787380419.281112:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281126:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380419.281175:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787380419.281179:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380419.281204:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281218:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281227:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281232:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281239:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281244:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380419.281249:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281255:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281296:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380419.281299:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380419.281303:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281310:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842ee7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281325:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281331:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281406:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281413:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ea00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380419.281416:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281422:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281430:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911da00) 00010000:00010000:2.0:1787380419.281432:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380419.281435:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281453:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281518:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842ee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6995 expref: 44 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281530:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6995 expref: 43 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.281539:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:2.0:1787380419.281541:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380419.281544:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fe00, rc 0) 00000100:00100000:2.0:1787380419.281605:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:11414:x1874203915655424:12345-192.168.206.14@tcp:101:stat.0 Request processed in 21057us (21331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380419.281614:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 156 00000100:00100000:0.0:1787380419.367131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.367588:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915656064 00000100:00100000:1.0:1787380419.367597:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915656064 00000100:00100000:1.0:1787380419.367709:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 157 00000100:00100000:1.0:1787380419.367720:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:11420:x1874203915656064:12345-192.168.206.14@tcp:36:truncate.0 00010000:00010000:1.0:1787380419.367774:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380419.367799:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842ef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6995 expref: 43 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.367830:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.367835:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380419.369353:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.369372:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.369383:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380419.369443:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1787380419.369468:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007eed1277 reply state 00000000b6a20500 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380419.369476:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380419.369569:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:11420:x1874203915656064:12345-192.168.206.14@tcp:36:truncate.0 Request processed in 1848us (2442us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1787380419.369577:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 157 00000020:00080000:1.0:1787380419.369583:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380419.373285:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.373305:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.373313:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.373319:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ee00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.373749:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.373759:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.373775:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.373778:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.373783:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.373789:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842efc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.555154:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.555856:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915656192 00000100:00100000:1.0:1787380419.555866:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915656192 00000100:00100000:1.0:1787380419.555936:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 158 00000100:00100000:1.0:1787380419.555946:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+44:11434:x1874203915656192:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:1.0:1787380419.555969:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380419.555989:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f699c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556091:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556104:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556126:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556143:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556158:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556166:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556279:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556288:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556296:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380419.556333:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787380419.556366:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380419.556387:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556398:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556407:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556414:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556420:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556436:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.556440:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556447:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556458:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380419.556461:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.556466:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556471:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556484:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556489:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556709:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556717:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.556720:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556726:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556744:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d100) 00010000:00010000:1.0:1787380419.556747:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.556749:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556754:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556790:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 46 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556803:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 45 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.556810:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.556812:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380419.556814:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515ea00, rc 0) 00000100:00100000:1.0:1787380419.556880:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:11434:x1874203915656192:12345-192.168.206.14@tcp:101:stat.0 Request processed in 935us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380419.556887:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 158 00000100:00100000:2.0:1787380419.666529:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380419.666601:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915656448 00000100:00100000:3.0:1787380419.666610:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915656448 00000100:00100000:3.0:1787380419.666672:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 159 00000100:00100000:3.0:1787380419.666680:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+45:11444:x1874203915656448:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380419.666698:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380419.666714:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69a3 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380419.666814:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787380419.666934:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69a3 expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380419.666959:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:3.0:1787380419.666962:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380419.666967:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69a3 expref: 47 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380419.666983:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380419.667040:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+46:11444:x1874203915656448:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 360us (519us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1787380419.667046:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 159 00000100:00100000:0.0:1787380419.671024:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380419.672107:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915656704 00000100:00100000:3.0:1787380419.672119:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915656704 00000100:00100000:3.0:1787380419.672175:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:3.0:1787380419.672185:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f13b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+46:11444:x1874203915656704:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:3.0:1787380419.672468:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f13b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:11444:x1874203915656704:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 284us (1453us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787380419.672476:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:0.0:1787380419.769699:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.770474:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915656960 00000100:00100000:1.0:1787380419.770484:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915656960 00000100:00100000:1.0:1787380419.770549:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 160 00000100:00100000:1.0:1787380419.770559:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+47:11450:x1874203915656960:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380419.770583:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380419.770605:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69aa expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.770722:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.770736:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 48 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.770745:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.770778:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 48 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.770791:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 48 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380419.770804:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935582464:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380419.770946:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a039dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380419.785959:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.787386:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935582464:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380419.787414:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.790334:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915657088 00000100:00100000:0.0:1787380419.790373:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915657088 00010000:00010000:0.0:1787380419.790424:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 49 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.790484:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:0.0:1787380419.790495:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+49:2356:x1874203915657088:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380419.790510:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380419.790517:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 49 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.790531:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 49 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.790572:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118842f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f699c expref: 49 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.790589:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380419.790593:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.790601:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.790607:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.790641:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380419.790699:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.790701:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:2356:x1874203915657088:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 208us (4751us total) trans 0 rc 0/0 00010000:00010000:1.0:1787380419.790717:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.790720:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 67 00000004:00200000:1.0:1787380419.790740:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787380419.790895:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 49 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.790911:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 48 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.790918:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.790921:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380419.790934:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e000, rc 0) 00000100:00100000:1.0:1787380419.790961:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:11450:x1874203915656960:12345-192.168.206.14@tcp:101:bash.0 Request processed in 20404us (21270us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1787380419.790969:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 160 00000100:00100000:0.0:1787380419.799972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380419.800089:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915657344 00000100:00100000:3.0:1787380419.800100:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915657344 00000100:00100000:3.0:1787380419.800154:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 161 00000100:00100000:3.0:1787380419.800163:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:11450:x1874203915657344:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:3.0:1787380419.800467:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380419.800484:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380419.800514:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380419.800569:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1787380419.800595:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd08d643 reply state 000000002682ee2c transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380419.800604:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380419.800678:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:11450:x1874203915657344:12345-192.168.206.14@tcp:36:bash.0 Request processed in 516us (714us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787380419.800686:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 161 00000020:00080000:3.0:1787380419.800691:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380419.802374:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.802391:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.802397:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.802403:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ca00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.802408:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.802415:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.802430:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.802433:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.802449:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.802455:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118842f42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.806743:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380419.807229:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915657472 00000100:00100000:2.0:1787380419.807241:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915657472 00000100:00100000:2.0:1787380419.807316:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 162 00000100:00100000:2.0:1787380419.807326:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:11450:x1874203915657472:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380419.807389:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380419.807409:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842f49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69b1 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.807739:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.807755:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.807780:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.807811:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.807825:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 51 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380419.807840:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585f0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935582592:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380419.808029:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380419.811682:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585f0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935582592:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380419.811712:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380419.811879:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380419.812041:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915657600 00000100:00100000:0.0:1787380419.812049:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915657600 00010000:00010000:0.0:1787380419.812091:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 52 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380419.812146:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:0.0:1787380419.812155:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:2355:x1874203915657600:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380419.812170:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380419.812177:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 52 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.812189:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 52 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.812209:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e000/0x651a07d118842f34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69aa expref: 52 pid: 5787 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.812224:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380419.812239:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.812248:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.812255:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.812285:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380419.812355:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:2355:x1874203915657600:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 181us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380419.812364:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 68 00010000:00010000:0.0:1787380419.812884:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.812901:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380419.814204:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787380419.814213:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380419.814253:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.814302:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118842f49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69b1 expref: 51 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.814320:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69b1 expref: 50 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380419.814329:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:2.0:1787380419.814331:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380419.814334:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3c00, rc 0) 00000100:00100000:2.0:1787380419.814432:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:11450:x1874203915657472:12345-192.168.206.14@tcp:101:bash.0 Request processed in 7106us (7698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380419.814453:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 162 00000100:00100000:0.0:1787380419.821847:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380419.821933:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915657856 00000100:00100000:3.0:1787380419.821942:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915657856 00000100:00100000:3.0:1787380419.821996:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:3.0:1787380419.822006:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:11450:x1874203915657856:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:3.0:1787380419.822247:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:11450:x1874203915657856:12345-192.168.206.14@tcp:35:bash.0 Request processed in 241us (410us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1787380419.822256:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:3.0:1787380419.902754:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380419.904463:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915658112 00000100:00100000:0.0:1787380419.904477:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915658112 00000100:00100000:0.0:1787380419.904617:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 163 00000100:00100000:0.0:1787380419.904638:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:11460:x1874203915658112:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380419.904762:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380419.904783:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69b8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380419.904951:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787380419.905051:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842f57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69b8 expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.905077:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:0.0:1787380419.905081:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380419.905085:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d118842f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69b8 expref: 53 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.905099:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1ee00, rc 0) 00000100:00100000:0.0:1787380419.905284:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11460:x1874203915658112:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 657us (2537us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1787380419.905292:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 163 00000100:00100000:0.0:1787380419.907041:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.907135:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915658240 00000100:00100000:1.0:1787380419.907145:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915658240 00000100:00100000:1.0:1787380419.907205:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 164 00000100:00100000:1.0:1787380419.907214:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11460:x1874203915658240:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:1.0:1787380419.907294:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907309:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907321:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907334:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907379:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907386:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907814:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907825:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907848:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380419.907894:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907906:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907912:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907919:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907925:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ee00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.907929:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907936:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907947:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380419.907950:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.907954:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907960:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907971:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907983:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907989:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.907993:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.907996:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908002:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908010:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d100) 00010000:00010000:1.0:1787380419.908013:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.908015:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908021:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908036:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908042:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908047:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908052:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.908074:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908081:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908089:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.908091:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.908094:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.908100:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380419.908226:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11460:x1874203915658240:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 1011us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380419.908236:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 164 00000100:00100000:3.0:1787380419.910991:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380419.911052:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915658496 00000100:00100000:0.0:1787380419.911084:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915658496 00000100:00100000:0.0:1787380419.911141:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:0.0:1787380419.911150:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11460:x1874203915658496:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380419.911869:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:11460:x1874203915658496:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 716us (884us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787380419.911879:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:3.0:1787380419.951928:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.952036:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915658752 00000100:00100000:1.0:1787380419.952047:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915658752 00000100:00100000:1.0:1787380419.952123:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 165 00000100:00100000:1.0:1787380419.952133:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+53:11463:x1874203915658752:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380419.952157:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380419.952256:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69bf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952558:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952572:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952603:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952619:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952626:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952633:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952952:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842f8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952962:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.952969:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380419.952978:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787380419.953082:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953090:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953096:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953103:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.953114:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953122:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953134:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380419.953138:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.953142:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953149:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842f81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953855:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953867:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953873:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953877:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ee00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.953880:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953886:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953896:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d100) 00010000:00010000:1.0:1787380419.953899:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380419.953911:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953917:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953966:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69bf expref: 56 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953979:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69bf expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.953987:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.953990:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380419.953993:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fa00, rc 0) 00000100:00100000:1.0:1787380419.954074:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11463:x1874203915658752:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1942us (2155us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787380419.954083:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 165 00000100:00100000:2.0:1787380419.962975:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380419.963016:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.963096:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915658880 00000100:00100000:1.0:1787380419.963105:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915658880 00000100:00100000:1.0:1787380419.963168:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:1.0:1787380419.963178:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11463:x1874203915658880:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:1.0:1787380419.963240:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963257:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963280:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963334:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963380:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963387:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963393:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380419.963397:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963405:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963417:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:1.0:1787380419.963420:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380419.963425:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380419.963431:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380419.963492:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11463:x1874203915658880:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 315us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380419.963501:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:0.0:1787380419.963948:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915659008 00000100:00100000:0.0:1787380419.963955:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915659008 00000100:00100000:0.0:1787380419.964005:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:0.0:1787380419.964014:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:2353:x1874203915659008:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380419.964025:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380419.964040:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118842f8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69bf expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380419.964052:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380419.964066:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380419.964091:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:2353:x1874203915659008:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 78us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380419.964098:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:0.0:1787380419.966511:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380419.966586:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915659264 00000100:00100000:1.0:1787380419.966596:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915659264 00000100:00100000:1.0:1787380419.966649:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:1.0:1787380419.966672:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:11463:x1874203915659264:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380419.966899:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11463:x1874203915659264:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 229us (396us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787380419.966907:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 47 00010000:00010000:3.0:1787380420.087661:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380420.145524:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.145692:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915659520 00000100:00100000:0.0:1787380420.145702:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915659520 00000100:00100000:0.0:1787380420.145768:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:0.0:1787380420.145779:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11482:x1874203915659520:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:0.0:1787380420.145803:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380420.145823:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69c6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.145930:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842fab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.145945:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842fab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.145957:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842fab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380420.145968:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787380420.146104:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69c6 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.146123:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69c6 expref: 57 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.146132:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380420.146135:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787380420.146138:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380420.146212:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11482:x1874203915659520:12345-192.168.206.14@tcp:101:cat.0 Request processed in 435us (696us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787380420.146219:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:2.0:1787380420.186235:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.186396:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915659648 00000100:00100000:1.0:1787380420.186405:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915659648 00000100:00100000:1.0:1787380420.186467:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 168 00000100:00100000:1.0:1787380420.186477:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11483:x1874203915659648:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380420.186509:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380420.186527:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842fb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69cd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.186596:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842fc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.186608:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.186618:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380420.186673:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787380420.186676:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380420.186697:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.186722:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842fb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69cd expref: 59 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.186755:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69cd expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.186762:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380420.186765:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380420.186768:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515ee00, rc 0) 00000100:00100000:1.0:1787380420.187132:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11483:x1874203915659648:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 654us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380420.187140:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 168 00000100:00100000:3.0:1787380420.191504:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.191841:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915660032 00000100:00100000:1.0:1787380420.191852:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915660032 00000100:00100000:1.0:1787380420.191906:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:1.0:1787380420.191915:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11483:x1874203915660032:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380420.192404:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11483:x1874203915660032:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 488us (914us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787380420.192412:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:2.0:1787380420.195217:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.197385:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915660160 00000100:00100000:0.0:1787380420.197398:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915660160 00000100:00100000:0.0:1787380420.197473:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:0.0:1787380420.197482:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11483:x1874203915660160:12345-192.168.206.14@tcp:103:lfs.0 00010000:00010000:0.0:1787380420.197962:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787380420.197999:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d118842f50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69b1 expref: 59 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.198024:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842fab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69c6 expref: 58 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.198037:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6972 expref: 57 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.198046:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380420.198068:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380420.198142:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:11483:x1874203915660160:12345-192.168.206.14@tcp:103:lfs.0 Request processed in 661us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380420.198150:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1787380420.202034:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.202163:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915660288 00000100:00100000:0.0:1787380420.202172:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915660288 00000100:00100000:0.0:1787380420.202333:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 169 00000100:00100000:0.0:1787380420.202377:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:11483:x1874203915660288:12345-192.168.206.14@tcp:58:lfs.0 00010000:00010000:0.0:1787380420.202475:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.202490:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.202510:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787380420.202703:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787380420.202781:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:11483:x1874203915660288:12345-192.168.206.14@tcp:58:lfs.0 Request processed in 407us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380420.202798:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 169 00000100:00100000:2.0:1787380420.227866:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.228100:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915660416 00000100:00100000:1.0:1787380420.228110:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915660416 00000100:00100000:1.0:1787380420.228174:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 170 00000100:00100000:1.0:1787380420.228184:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:11485:x1874203915660416:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380420.228204:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380420.228222:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842fce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69d4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228290:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228316:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228327:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228365:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228373:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228381:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228472:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228480:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228487:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380420.228522:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787380420.228525:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380420.228542:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228553:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228570:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228576:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228581:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228586:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380420.228590:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228597:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228609:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380420.228611:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380420.228615:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228621:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118842fd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228634:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228640:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228645:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228656:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380420.228659:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228665:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228673:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d100) 00010000:00010000:1.0:1787380420.228675:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380420.228678:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228683:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d118842fdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228715:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118842fce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228728:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.228734:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:1.0:1787380420.228736:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380420.228739:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515ec00, rc 0) 00000100:00100000:1.0:1787380420.228799:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11485:x1874203915660416:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 617us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380420.228807:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 170 00000001:00080000:0.0:1787380420.411434:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787380420.411454:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000040:00080000:3.0:1787380420.599662:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380420.599671:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380420.599840:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787380420.599847:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380420.599962:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bceeb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935582720:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787380420.600065:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698de3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380420.605325:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bceeb480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935582720:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380420.605601:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.605670:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915660544 00000100:00100000:0.0:1787380420.605676:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915660544 00000100:00100000:0.0:1787380420.605733:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 171 00000100:00100000:0.0:1787380420.605743:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11496:x1874203915660544:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787380420.605789:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787380420.605884:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11496:x1874203915660544:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 141us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380420.605892:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 171 00000100:00100000:2.0:1787380420.608942:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.609029:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915660672 00000100:00100000:0.0:1787380420.609037:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915660672 00000100:00100000:0.0:1787380420.609106:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 172 00000100:00100000:0.0:1787380420.609115:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11496:x1874203915660672:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787380420.609181:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609197:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609218:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609274:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609282:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609302:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609334:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609372:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609379:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380420.609414:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787380420.609418:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380420.609430:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609439:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609445:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609452:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609458:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.609463:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609469:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609488:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:0.0:1787380420.609491:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380420.609496:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609502:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118842fea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609517:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609523:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609528:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609533:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.609536:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609541:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609549:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9d96991e8000) 00010000:00010000:0.0:1787380420.609551:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380420.609553:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609558:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118842ff1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609583:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609589:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609595:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609600:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.609602:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609608:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609615:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380420.609617:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380420.609620:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.609626:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d118842ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380420.609699:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11496:x1874203915660672:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 Request processed in 584us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380420.609709:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 172 00000100:00100000:2.0:1787380420.614244:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.615518:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915660928 00000100:00100000:0.0:1787380420.615530:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915660928 00000100:00100000:0.0:1787380420.615594:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 173 00000100:00100000:0.0:1787380420.615616:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11496:x1874203915660928:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380420.615635:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380420.615654:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842fff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69db expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615756:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615771:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615782:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380420.615793:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787380420.615879:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615887:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615893:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615899:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.615903:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615911:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615923:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380420.615931:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380420.615936:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615943:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615979:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842fff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69db expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.615988:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:0.0:1787380420.615991:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380420.615995:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1fe00/0x651a07d118842fff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69db expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.616004:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1fe00, rc 0) 00000100:00100000:0.0:1787380420.616076:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11496:x1874203915660928:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 461us (1838us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1787380420.616083:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 173 00000100:00100000:3.0:1787380420.619937:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.620093:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915661056 00000100:00100000:0.0:1787380420.620103:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915661056 00000100:00100000:0.0:1787380420.620159:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 174 00000100:00100000:0.0:1787380420.620167:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11496:x1874203915661056:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787380420.620199:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787380420.620296:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11496:x1874203915661056:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 129us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380420.620303:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 174 00000100:00100000:0.0:1787380420.643048:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.643138:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915661312 00000100:00100000:1.0:1787380420.643157:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915661312 00000100:00100000:1.0:1787380420.643219:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 175 00000100:00100000:1.0:1787380420.643229:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11496:x1874203915661312:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380420.643249:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380420.643252:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787380420.643283:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d118842fc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69cd expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.643299:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380420.643305:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380420.643319:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843014 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69e2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380420.644108:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787380420.644323:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d11884301b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.644654:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d11884301b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.644669:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d11884301b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.644734:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843014 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e2 expref: 60 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.644749:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d11884301b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e2 expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.644757:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:0.0:1787380420.644760:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380420.644762:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e400, rc 0) 00000100:00100000:0.0:1787380420.644940:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11496:x1874203915661312:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1711us (1899us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787380420.644949:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 175 00000100:00100000:0.0:1787380420.658699:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380420.662644:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915661568 00000100:00100000:2.0:1787380420.662658:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915661568 00000100:00100000:2.0:1787380420.662761:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 176 00000100:00100000:2.0:1787380420.662771:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11496:x1874203915661568:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787380420.662825:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380420.662852:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d11884301b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e2 expref: 59 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.662870:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d96991e8000) 00010000:00010000:2.0:1787380420.662883:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380420.662910:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.662923:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.662933:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.662961:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.662969:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.662975:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663045:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663064:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663071:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663077:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380420.663080:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663087:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663096:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380420.663099:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380420.663102:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663108:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843029 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663126:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663132:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663138:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663145:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380420.663148:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663155:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663164:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1dcdc170 (ffff9d969371a800) 00010000:00010000:2.0:1787380420.663166:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380420.663168:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.663173:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843030 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1dcdc170 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380420.663276:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11496:x1874203915661568:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 504us (4584us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380420.663283:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 176 00000100:00100000:3.0:1787380420.668537:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380420.668572:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915661696 00000100:00100000:3.0:1787380420.668581:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915661696 00000100:00100000:3.0:1787380420.668633:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 177 00000100:00100000:3.0:1787380420.668643:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11496:x1874203915661696:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380420.668662:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380420.668683:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843037 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69e9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.668718:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.668730:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.668742:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.668833:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.668868:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.668876:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380420.668880:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380420.668883:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216de00, rc 0) 00000100:00100000:3.0:1787380420.668936:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11496:x1874203915661696:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 295us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380420.668943:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 177 00000100:00100000:3.0:1787380420.672291:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380420.672332:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915661952 00000100:00100000:3.0:1787380420.672358:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915661952 00000100:00100000:3.0:1787380420.672409:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 178 00000100:00100000:3.0:1787380420.672419:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11496:x1874203915661952:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380420.672495:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.672510:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.672522:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380420.674531:0:7761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787380420.674547:0:7761:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370986208054ns, next at 371986205802ns, rc = 0 00000004:00010000:3.0:1787380420.674639:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbecaa9e reply state 00000000e2ad12bc transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.674663:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380420.674771:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11496:x1874203915661952:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 2351us (2484us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787380420.674779:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 178 00010000:00010000:3.0:1787380420.676810:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.676824:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.676832:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.676839:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380420.676843:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.676850:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.676865:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380420.676868:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787380420.676872:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.676878:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843045 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.681299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380420.681404:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915662080 00000100:00100000:3.0:1787380420.681414:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915662080 00000100:00100000:3.0:1787380420.681489:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 179 00000100:00100000:3.0:1787380420.681508:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11496:x1874203915662080:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380420.681532:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380420.681553:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69f0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.681627:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 61 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.681642:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 61 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.681661:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380420.681664:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380420.681668:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380420.681718:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11496:x1874203915662080:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 212us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380420.681727:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 179 00000100:00100000:3.0:1787380420.686199:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380420.686773:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915662208 00000100:00100000:2.0:1787380420.686785:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915662208 00000100:00100000:2.0:1787380420.686855:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:2.0:1787380420.686875:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2356:x1874203915662208:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787380420.687195:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915662208:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 321us (1004us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787380420.687203:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00080000:0.0:1787380420.688658:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380420.690924:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.691033:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915662464 00000100:00100000:1.0:1787380420.691044:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915662464 00000100:00100000:1.0:1787380420.691118:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:1.0:1787380420.691128:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11496:x1874203915662464:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787380420.691412:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11496:x1874203915662464:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 284us (497us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787380420.691421:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:3.0:1787380420.693462:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.693714:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915662720 00000100:00100000:1.0:1787380420.693725:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915662720 00000100:00100000:1.0:1787380420.693785:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 180 00000100:00100000:1.0:1787380420.693793:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11496:x1874203915662720:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787380420.693893:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11496:x1874203915662720:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 100us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380420.693913:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 180 00000100:00100000:3.0:1787380420.696709:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.697965:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915662848 00000100:00100000:1.0:1787380420.697977:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915662848 00000100:00100000:1.0:1787380420.698098:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 181 00000100:00100000:1.0:1787380420.698110:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11496:x1874203915662848:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380420.698134:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380420.698153:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69f7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.698225:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884305a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.698239:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884305a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.698252:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884305a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380420.698305:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380420.698323:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884305a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.698380:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f7 expref: 64 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.698400:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884305a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f7 expref: 63 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.698409:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380420.698424:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787380420.698428:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f200, rc 0) 00000100:00100000:1.0:1787380420.698494:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+63:11496:x1874203915662848:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 385us (1792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380420.698502:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 181 00000100:00100000:0.0:1787380420.707858:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380420.707946:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915662976 00000100:00100000:2.0:1787380420.707957:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915662976 00000100:00100000:2.0:1787380420.708015:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:2.0:1787380420.708024:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915662976:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380420.708043:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380420.708072:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f69fe expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380420.708101:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8942c4, blocks: 0x1 00010000:00010000:2.0:1787380420.708120:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1787380420.708125:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380420.708135:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 8 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.708154:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 8 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.708168:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3000, rc 0) 00000100:00100000:2.0:1787380420.708221:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915662976:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 198us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380420.708229:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:0.0:1787380420.711850:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380420.711919:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915663232 00000100:00100000:2.0:1787380420.711929:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915663232 00000100:00100000:2.0:1787380420.711990:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 182 00000100:00100000:2.0:1787380420.712000:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+63:11496:x1874203915663232:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787380420.712105:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+63:11496:x1874203915663232:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380420.712113:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 182 00000100:00100000:3.0:1787380420.721181:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380420.721214:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915663360 00000100:00100000:3.0:1787380420.721223:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915663360 00000100:00100000:3.0:1787380420.721268:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:3.0:1787380420.721278:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:11496:x1874203915663360:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380420.721307:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380420.721325:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a05 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.721379:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 9 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.721389:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380420.721394:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380420.721399:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 9 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.721429:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 9 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.721442:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 9 pid: 8465 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.721456:0:6577:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6577:1874203935582848:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380420.721538:0:6577:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380420.730626:0:6577:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6577:1874203935582848:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380420.730661:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 9 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.730681:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d000, rc 0) 00000100:00100000:3.0:1787380420.730737:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b56a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:11496:x1874203915663360:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 9460us (9561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380420.730745:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:3.0:1787380420.736165:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.736253:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915663488 00000100:00100000:0.0:1787380420.736272:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915663488 00010000:00010000:0.0:1787380420.736545:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 9 pid: 8465 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380420.736617:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:0.0:1787380420.736627:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915663488:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380420.736643:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380420.736667:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 9 pid: 8465 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.736680:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 9 pid: 8465 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.736703:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bec8422/0x651a07d118843061 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69fe expref: 9 pid: 8465 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.736718:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380420.736723:0:11008:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380420.736730:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.736740:0:11008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.736772:0:11008:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380420.736786:0:11008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5232300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11008:1874203935582976:192.168.206.14@tcp:105: 00000100:00100000:0.0:1787380420.736866:0:11008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ba13c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380420.744588:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.744629:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915663616 00000100:00100000:0.0:1787380420.744639:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915663616 00002000:00100000:0.0:1787380420.744700:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d96b5230a80 x1874203915663616/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:226/0 lens 504/0 e 0 to 0 dl 1787380431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380420.744710:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5230a80 with x1874203915663616 ext(0->8) 00002000:00010000:0.0:1787380420.744715:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96b5230a80 00000100:00100000:0.0:1787380420.744744:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:0.0:1787380420.744753:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915663616:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787380420.744970:0:11008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5232300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11008:1874203935582976:192.168.206.14@tcp:105: 00010000:00010000:3.0:1787380420.745030:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380420.745107:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2356:x1874203915663488:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 8479us (8949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380420.745117:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:0.0:1787380420.745185:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2356:x1874203915663616:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 Request processed in 432us (603us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787380420.745193:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00002000:00100000:0.0:1787380420.745201:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d96b5230a80 x1874203915663616/t4294967314(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:226/0 lens 504/448 e 0 to 0 dl 1787380431 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380420.745209:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96b5230a80 with x1874203915663616 ext(0->8) 00002000:00010000:0.0:1787380420.745213:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96b5230a80 00000100:00100000:3.0:1787380420.747421:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.748373:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915663744 00000100:00100000:1.0:1787380420.748384:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915663744 00000100:00100000:1.0:1787380420.748443:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 183 00000100:00100000:1.0:1787380420.748453:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+63:11496:x1874203915663744:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787380420.838031:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:2.0:1787380420.838087:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1787380420.838126:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787380420.838162:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787380420.838194:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d96aaf9e540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787380420.838198:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d95866b7100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d968af4fb40 00000020:00080000:2.0:1787380420.838201:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d95866b7d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d96bd253400 00000020:00080000:2.0:1787380420.838223:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1787380420.838280:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935583104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787380420.838373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787380420.838410:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787380420.838430:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380420.838452:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935583232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787380420.838477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380420.838512:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935583104 00000100:00100000:0.0:1787380420.838519:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935583104 00000100:00100000:0.0:1787380420.838570:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935583232 00000100:00080000:3.0:1787380420.838584:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380420.838585:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935583232 00000100:00080000:3.0:1787380420.838604:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380420.838614:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787380420.838622:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935583104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787380420.838647:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787380420.838675:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8942c1, atime: 0x6a8942c2, ctime: 0x6a8942c1, blocks: 0xb 00010000:00010000:0.0:1787380420.838683:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.838698:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1787380420.838703:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380420.838711:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.838727:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.838739:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380420.838745:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1787380420.838747:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380420.838754:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935583232:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787380420.838772:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787380420.838868:0:6576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787380420.838871:0:6576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787380420 00002000:00010000:2.0:1787380420.838873:0:6576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787380420.838875:0:6576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787380420 -> 1787380420 00002000:00010000:2.0:1787380420.838878:0:6576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787380420.838964:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935583232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (485us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787380420.838972:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:3.0:1787380420.839037:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380420.839044:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.839064:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380420.839069:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.839078:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.839093:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.839100:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c96e7ec5/0x651a07d11884306f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.839123:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380420.839125:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380420.839127:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380420.839422:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935583104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 800us (1048us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787380420.839439:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787380420.839528:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11496:x1874203915663744:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 Request processed in 91076us (92115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380420.839544:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 183 00000004:00080000:1.0:1787380420.840821:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b5232300/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787380420.840832:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935583232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787380420.840905:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787380420.840911:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787380420.840933:0:3301:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d96b5231880 x1874203935583104/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787380436 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787380420.840942:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b5231880/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787380420.840946:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5231880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935583104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787380420.843414:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.843554:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915663872 00000100:00100000:0.0:1787380420.843565:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915663872 00000100:00100000:0.0:1787380420.843621:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:0.0:1787380420.843631:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2353:x1874203915663872:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787380420.895508:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1787380420.895530:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787380420.895791:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915663872:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 Request processed in 52156us (52379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380420.895804:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:2.0:1787380420.909213:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.909283:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915664128 00000100:00100000:1.0:1787380420.909293:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915664128 00000100:00100000:1.0:1787380420.909376:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 184 00000100:00100000:1.0:1787380420.909388:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11496:x1874203915664128:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787380420.909438:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380420.909465:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d11884305a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f7 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.909481:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380420.909485:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380420.909512:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.909524:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.909539:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380420.909738:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012c05d3d reply state 000000007a7976b1 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.909747:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380420.909835:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:11496:x1874203915664128:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 450us (631us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1787380420.909842:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 184 00010000:00010000:2.0:1787380420.911875:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.911891:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.911899:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.911906:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380420.911911:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.911920:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:2.0:1787380420.911924:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.911942:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:2.0:1787380420.911945:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380420.911950:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.911956:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d118843076 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.912077:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915664256 00000100:00100000:3.0:1787380420.912085:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915664256 00000100:00100000:3.0:1787380420.912137:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:3.0:1787380420.912147:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915664256:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787380420.912392:0:6578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787380420.912396:0:6578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787380420 -> 1787380419 00002000:00010000:3.0:1787380420.912399:0:6578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787380418 00002000:00010000:3.0:1787380420.912401:0:6578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787380420 -> 1787380419 00002000:00010000:3.0:1787380420.912404:0:6578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787380420.912470:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915664256:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 324us (557us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787380420.912477:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:0.0:1787380420.916136:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380420.916291:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915664512 00000100:00100000:3.0:1787380420.916302:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915664512 00000100:00100000:3.0:1787380420.916399:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 185 00000100:00100000:3.0:1787380420.916410:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11496:x1874203915664512:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787380420.916491:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.916507:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.916526:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.916559:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.916571:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 18 pid: 5786 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.916594:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935583360:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380420.916677:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380420.926468:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380420.926501:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915664640 00000100:00100000:1.0:1787380420.926510:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915664640 00010000:00010000:1.0:1787380420.926544:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 19 pid: 5786 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.926579:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:1.0:1787380420.926588:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:2355:x1874203915664640:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380420.926601:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380420.926608:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 19 pid: 5786 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.926621:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 19 pid: 5786 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.926644:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:1.0:1787380420.926656:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.926666:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.926673:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.926692:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380420.926739:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:2355:x1874203915664640:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 152us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380420.926747:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00010000:00010000:3.0:1787380420.927361:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d11884303e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69e9 expref: 18 pid: 5786 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.927387:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd264700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935583360:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380420.927406:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927414:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927421:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927803:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927813:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927828:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927836:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380420.927841:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927849:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927867:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380420.927870:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787380420.927874:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.927880:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884307d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.927959:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:11496:x1874203915664512:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 Request processed in 11549us (11829us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787380420.927969:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 185 00000100:00100000:3.0:1787380420.935611:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380420.950732:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915664768 00000100:00100000:2.0:1787380420.950758:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915664768 00000100:00100000:2.0:1787380420.950960:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:2.0:1787380420.950971:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915664768:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787380420.951013:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.951033:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.951043:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380420.951047:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380420.951066:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.951104:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.951118:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 8 pid: 6577 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380420.951133:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585f0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1874203935583488:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380420.951217:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96957a76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380420.957541:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380420.957594:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585f0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1874203935583488:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380420.957606:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915664896 00000100:00100000:3.0:1787380420.957615:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915664896 00010000:00010000:2.0:1787380420.957622:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.957652:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 9 pid: 6577 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.957746:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 71 00000100:00100000:3.0:1787380420.957756:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2355:x1874203915664896:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380420.957779:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380420.957801:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 9 pid: 6577 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.957813:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 9 pid: 6577 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.957836:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000278ba98b/0x651a07d118843068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a05 expref: 9 pid: 6577 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.957851:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380420.957855:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380420.957860:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.957870:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.957902:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380420.957951:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915664896:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 197us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380420.957958:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 71 00010000:00010000:2.0:1787380420.958086:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958096:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958129:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958138:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958147:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958155:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3a00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380420.958160:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958171:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958185:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380420.958206:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a7dabc/0x651a07d118843084 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380420.958272:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915664768:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 Request processed in 7295us (22661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380420.958282:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:1.0:1787380420.966142:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380420.966231:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915665152 00000100:00100000:3.0:1787380420.966240:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915665152 00000100:00100000:3.0:1787380420.966548:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 186 00000100:00100000:3.0:1787380420.966559:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+17:11496:x1874203915665152:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787380420.966660:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.966675:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.966686:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.966882:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.966894:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.966902:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.966933:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.966953:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 18 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.966969:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935583616:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380420.967071:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380420.968917:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935583616:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380420.968947:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.970928:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380420.971707:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915665280 00000100:00100000:3.0:1787380420.971719:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915665280 00010000:00010000:3.0:1787380420.971764:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 19 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380420.971800:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00100000:3.0:1787380420.971810:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:2355:x1874203915665280:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380420.971823:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380420.971829:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 19 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.971841:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 19 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.971861:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884304c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69f0 expref: 19 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.971877:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:3.0:1787380420.971882:0:11008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.971891:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.971898:0:11008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.971924:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380420.971986:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:2355:x1874203915665280:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 177us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380420.971993:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 72 00010000:00010000:3.0:1787380420.972098:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.972106:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380420.972274:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787380420.974962:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787380420.975047:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787380420.975145:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1874203935583744:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787380420.975208:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380420.975245:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380420.976139:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935583744 00000100:00100000:1.0:1787380420.976149:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935583744 00000100:00100000:1.0:1787380420.976211:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380420.976220:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1874203935583744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787380420.976327:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1874203935583744:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380420.976353:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380420.976397:0:5786:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787380420.976402:0:5786:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b5232300, transno 4294967315 00000100:00100000:1.0:1787380420.976542:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd266300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1874203935583744:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787380420.977114:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1787380420.977193:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1874203935583872:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787380420.977248:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380420.977280:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a039d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380420.977427:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935583872 00000100:00100000:2.0:1787380420.977433:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935583872 00000100:00100000:2.0:1787380420.977466:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380420.977474:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1874203935583872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787380420.978019:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5786:x1874203935583872:12345-0@lo:1000:mdt00_000.0 Request processed in 543us (768us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787380420.978027:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380420.978122:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5786:1874203935583872:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787380420.978156:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978166:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978173:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978179:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.978183:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978191:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978207:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d968727f300) 00010000:00010000:0.0:1787380420.978210:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380420.978223:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978229:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843092 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978259:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978453:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978459:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978464:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.978467:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978474:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978483:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380420.978485:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380420.978488:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978493:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118842fc7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978514:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978527:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978819:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978849:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.978862:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 21 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380420.978875:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935584000:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380420.980604:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380420.991784:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380420.991814:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935584000:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380420.991821:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915665408 00000100:00100000:1.0:1787380420.991828:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915665408 00010000:00010000:0.0:1787380420.991842:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.991862:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 22 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.991897:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 73 00000100:00100000:1.0:1787380420.991906:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:2356:x1874203915665408:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380420.991919:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380420.991926:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 22 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.991938:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 22 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.991959:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118842fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f69d4 expref: 22 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.991973:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:1.0:1787380420.991979:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.991988:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.991995:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380420.992030:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380420.992091:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.992098:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2356:x1874203915665408:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 191us (321us total) trans 0 rc 0/0 00010000:00010000:0.0:1787380420.992101:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380420.992111:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 73 00010000:00010000:0.0:1787380420.992117:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992125:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992131:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992144:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.992149:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992157:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992166:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380420.992169:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380420.992172:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992178:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843099 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992188:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992194:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992199:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992203:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380420.992206:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992211:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992227:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380420.992229:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380420.992232:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.992237:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d11884308b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380420.992475:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:11496:x1874203915665152:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 25917us (26340us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1787380420.992483:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 186 00000020:00080000:0.0:1787380420.992487:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787380420.995086:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380420.995096:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380420.997665:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787380420.997684:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380421.003724:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380421.005885:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915665664 00000100:00100000:0.0:1787380421.005899:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915665664 00000100:00100000:0.0:1787380421.005967:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:0.0:1787380421.005979:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f138c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:11496:x1874203915665664:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787380421.006684:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787380421.006787:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1787380421.006833:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.006847:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.006859:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.006867:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.006883:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.006888:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.006912:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787380421.007009:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f138c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:11496:x1874203915665664:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 1030us (3290us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787380421.007018:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 50 00000020:00080000:0.0:1787380421.007024:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1787380421.007093:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787380421.007667:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380421.007676:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.007686:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380421.007690:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.007699:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.007715:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d96991e8200) 00010000:00010000:2.0:1787380421.007719:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787380421.007735:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.007742:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d1188430a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.008027:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380421.008030:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380421.008031:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787380421.103765:0:12359:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380421.103774:0:12359:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380421.103827:0:12359:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787380421.103833:0:12359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787380421.111960:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380421.245881:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.245961:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915665920 00000100:00100000:1.0:1787380421.245970:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915665920 00000100:00100000:1.0:1787380421.246035:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 187 00000100:00100000:1.0:1787380421.246045:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:11506:x1874203915665920:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380421.246078:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.246097:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188430a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a0c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.246367:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d1188430ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.246382:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d1188430ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.246393:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d1188430ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380421.246405:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787380421.246598:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188430a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a0c expref: 25 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.246627:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d1188430ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a0c expref: 24 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.246635:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380421.246639:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380421.246642:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f800, rc 0) 00000100:00100000:1.0:1787380421.246699:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:11506:x1874203915665920:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 655us (827us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787380421.246706:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 187 00000100:00100000:0.0:1787380421.257253:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.257375:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915666048 00000100:00100000:2.0:1787380421.257384:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915666048 00000100:00100000:2.0:1787380421.257438:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 188 00000100:00100000:2.0:1787380421.257447:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:11506:x1874203915666048:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:2.0:1787380421.257534:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257549:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257559:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257573:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257579:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257586:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257874:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257884:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257899:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380421.257938:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257952:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257958:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257965:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257971:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380421.257975:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257983:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.257996:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380421.257999:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380421.258004:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258010:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d1188430bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258022:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258035:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258040:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258045:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380421.258058:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258065:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258073:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d969371a800) 00010000:00010000:2.0:1787380421.258076:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380421.258078:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258083:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258099:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258105:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258111:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258115:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380421.258125:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258131:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258139:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d969371af00) 00010000:00010000:2.0:1787380421.258142:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380421.258144:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.258150:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3400/0x651a07d1188430ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.258228:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:11506:x1874203915666048:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 781us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380421.258236:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 188 00000100:00100000:1.0:1787380421.327721:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.327766:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915666304 00000100:00100000:1.0:1787380421.327775:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915666304 00000100:00100000:1.0:1787380421.327838:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 189 00000100:00100000:1.0:1787380421.327847:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+24:11509:x1874203915666304:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380421.327870:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.327892:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188430d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.327961:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.327976:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.327988:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328016:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328024:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328031:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328633:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328644:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328651:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380421.328662:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787380421.328748:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328756:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328763:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328768:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ee00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380421.328772:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328789:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328803:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380421.328806:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380421.328810:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328816:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ee00/0x651a07d1188430d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328829:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328834:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328839:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328844:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380421.328847:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328852:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328858:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d100) 00010000:00010000:1.0:1787380421.328860:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380421.328863:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328877:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e200/0x651a07d1188430df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328922:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188430d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 27 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328936:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 26 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.328942:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:1.0:1787380421.328944:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380421.328947:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:1.0:1787380421.329009:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:11509:x1874203915666304:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1161us (1296us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787380421.329017:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 189 00000100:00100000:3.0:1787380421.334785:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380421.334830:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915666432 00000100:00100000:3.0:1787380421.334839:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915666432 00000100:00100000:3.0:1787380421.334899:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 190 00000100:00100000:3.0:1787380421.334908:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:11509:x1874203915666432:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:3.0:1787380421.335041:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335065:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335077:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335101:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335113:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335119:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335124:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.335128:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335134:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335145:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:3.0:1787380421.335147:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380421.335151:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.335156:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188430f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.335221:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:11509:x1874203915666432:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 314us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380421.335228:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 190 00000100:00100000:0.0:1787380421.339586:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.339643:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915666688 00000100:00100000:1.0:1787380421.339653:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915666688 00000100:00100000:1.0:1787380421.339706:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:1.0:1787380421.339716:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:11509:x1874203915666688:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380421.339978:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:11509:x1874203915666688:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 263us (400us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787380421.339986:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:2.0:1787380421.369722:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935584128:0@lo:400:kworker.0 00000100:00100000:2.0:1787380421.369790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380421.369836:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380421.369842:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935584256:0@lo:400:kworker.0 00000100:00100000:2.0:1787380421.369869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380421.369899:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bceead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935584384:0@lo:400:kworker.0 00000100:00100000:2.0:1787380421.369922:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380421.369939:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380421.369944:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935584512:0@lo:400:kworker.0 00000100:00100000:2.0:1787380421.369968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380421.369997:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935584128 00000100:00100000:2.0:1787380421.370003:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935584128 00000100:00100000:2.0:1787380421.370066:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787380421.370075:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935584128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380421.370124:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935584128:12345-0@lo:400:kworker.0 Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380421.370131:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787380421.370174:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585f0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935584128:0@lo:400:kworker.0 00000100:00100000:1.0:1787380421.371460:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935584256 00000100:00100000:1.0:1787380421.371470:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935584256 00000100:00100000:1.0:1787380421.371523:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935584384 00000100:00100000:1.0:1787380421.371527:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935584384 00000100:00100000:2.0:1787380421.371546:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935584512 00000100:00100000:2.0:1787380421.371550:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935584512 00000100:00100000:1.0:1787380421.371567:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787380421.371575:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935584256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380421.371641:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935584256:12345-0@lo:400:kworker.0 Request processed in 67us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.371648:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787380421.371663:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787380421.371668:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935584384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380421.371697:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935584384:12345-0@lo:400:kworker.0 Request processed in 29us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.371703:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787380421.371715:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787380421.371720:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935584512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380421.371745:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874203935584512:12345-0@lo:400:kworker.0 Request processed in 25us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.371750:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1787380421.371876:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380421.372995:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5232300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935584256:0@lo:400:kworker.0 00000100:00100000:2.0:1787380421.376682:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935584512:0@lo:400:kworker.0 00000100:00100000:2.0:1787380421.376707:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bceead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935584384:0@lo:400:kworker.0 00000100:00100000:0.0:1787380421.379204:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.379376:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915666944 00000100:00100000:2.0:1787380421.379385:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915666944 00000100:00100000:2.0:1787380421.379451:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 191 00000100:00100000:2.0:1787380421.379461:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:11042:x1874203915666944:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380421.379485:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380421.379504:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a1a expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.379776:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.379791:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.379800:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.379842:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.379856:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 28 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.379869:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935584640:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380421.379946:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96957a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380421.391188:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.393687:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935584640:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380421.393716:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.393745:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915667072 00000100:00100000:1.0:1787380421.393750:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915667072 00010000:00010000:1.0:1787380421.393794:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 29 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.393831:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 74 00000100:00100000:1.0:1787380421.393854:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:2355:x1874203915667072:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380421.393873:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380421.393881:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 29 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.393893:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 29 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.394088:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188430e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a13 expref: 29 pid: 5787 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.394102:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:1.0:1787380421.394106:0:8292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.394117:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.394124:0:8292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.394154:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380421.394210:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:2355:x1874203915667072:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 356us (3030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.394218:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 74 00010000:00010000:3.0:1787380421.395197:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.395209:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380421.395242:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787380421.395425:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3c00/0x651a07d1188430fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 29 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.395442:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 28 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.395459:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:3.0:1787380421.395462:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380421.395465:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2600, rc 0) 00000100:00100000:3.0:1787380421.395750:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:11042:x1874203915666944:12345-192.168.206.14@tcp:101:bash.0 Request processed in 16289us (16553us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787380421.395759:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 191 00000100:00100000:0.0:1787380421.398894:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.399063:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915667328 00000100:00100000:1.0:1787380421.399072:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915667328 00000100:00100000:1.0:1787380421.399122:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 192 00000100:00100000:1.0:1787380421.399131:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:11042:x1874203915667328:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:1.0:1787380421.399404:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.399420:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.399430:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380421.399503:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1787380421.399530:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002dd0a121 reply state 00000000470036b9 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.399539:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787380421.399587:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1787380421.399684:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:11042:x1874203915667328:12345-192.168.206.14@tcp:36:bash.0 Request processed in 553us (799us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787380421.399692:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 192 00000020:00080000:1.0:1787380421.399696:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787380421.403032:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.403059:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.403068:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.403074:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.403078:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.403082:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:3.0:1787380421.403085:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.403113:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:3.0:1787380421.403116:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380421.403120:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.403127:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d118843110 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.403585:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915667456 00000100:00100000:1.0:1787380421.403593:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915667456 00000100:00100000:1.0:1787380421.403650:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 193 00000100:00100000:1.0:1787380421.403659:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:11042:x1874203915667456:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380421.403681:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.403696:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a21 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.403747:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843117 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a21 expref: 32 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.403772:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843117 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a21 expref: 32 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.403792:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:1.0:1787380421.403795:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380421.403798:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:1.0:1787380421.403850:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:11042:x1874203915667456:12345-192.168.206.14@tcp:101:bash.0 Request processed in 192us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.403857:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 193 00000100:00100000:2.0:1787380421.409660:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.409746:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915667584 00000100:00100000:1.0:1787380421.409755:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915667584 00000100:00100000:1.0:1787380421.409836:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:1.0:1787380421.409847:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:11042:x1874203915667584:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380421.409864:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.409883:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a28 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380421.409909:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8942c3, atime: 0x6a8942c2, ctime: 0x6a8942c3, blocks: 0xb 00010000:00010000:1.0:1787380421.409929:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1787380421.409934:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380421.409942:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.409958:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.409984:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e000, rc 0) 00000100:00100000:1.0:1787380421.410044:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:11042:x1874203915667584:12345-192.168.206.14@tcp:101:bash.0 Request processed in 199us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.410063:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:2.0:1787380421.412594:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380421.412683:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915667712 00000100:00100000:0.0:1787380421.412692:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915667712 00002000:00010000:0.0:1787380421.412729:0:6584:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787380421.412746:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bceead80 with x1874203915667712 ext(0->18446744073709551615) 00002000:00010000:0.0:1787380421.412757:0:6584:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96bceead80. 00000100:00100000:0.0:1787380421.412800:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:0.0:1787380421.412810:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915667712:12345-192.168.206.14@tcp:10:bash.0 00002000:00010000:0.0:1787380421.413064:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787380421.413068:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787380419 -> 1787380421 00002000:00010000:0.0:1787380421.413070:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787380418 -> 1787380418 00002000:00010000:0.0:1787380421.413072:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787380419 -> 1787380421 00002000:00010000:0.0:1787380421.413075:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787380421.413180:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915667712:12345-192.168.206.14@tcp:10:bash.0 Request processed in 370us (594us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787380421.413188:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00002000:00010000:0.0:1787380421.413191:0:6584:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787380421.413194:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bceead80 with x1874203915667712 ext(0->18446744073709551615) 00002000:00010000:0.0:1787380421.413198:0:6584:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96bceead80. 00000100:00100000:2.0:1787380421.483819:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.483894:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915667840 00000100:00100000:1.0:1787380421.483905:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915667840 00000100:00100000:1.0:1787380421.484063:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 194 00000100:00100000:1.0:1787380421.484075:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:11523:x1874203915667840:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:1.0:1787380421.484145:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.484161:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.484172:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.484186:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.484194:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.484199:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485071:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485084:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485093:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380421.485132:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485143:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485149:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485156:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485162:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ea00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.485166:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485182:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485195:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:3.0:1787380421.485198:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380421.485203:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485209:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d118843125 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485223:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485229:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485235:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485240:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.485243:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485249:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485256:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911da00) 00010000:00010000:3.0:1787380421.485259:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380421.485261:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485278:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e400/0x651a07d11884312c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485295:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485300:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485307:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485312:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.485315:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485321:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485328:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:3.0:1787380421.485330:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380421.485333:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.485430:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d118843133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.485520:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:11523:x1874203915667840:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 1445us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380421.485529:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 194 00000100:00100000:1.0:1787380421.521249:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.521633:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915668096 00000100:00100000:2.0:1787380421.521643:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915668096 00000100:00100000:2.0:1787380421.521711:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 195 00000100:00100000:2.0:1787380421.521720:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+32:11526:x1874203915668096:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380421.521740:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380421.521760:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884313a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a2f expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.521986:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.522001:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.522012:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.522040:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.522060:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.522068:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522771:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884314f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522782:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884314f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522790:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884314f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380421.522800:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787380421.522881:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522889:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522895:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522901:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.522905:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522913:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522925:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:3.0:1787380421.522927:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380421.522932:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522938:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d118843141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522962:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522968:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522975:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522980:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.522983:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522989:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.522996:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d969371af00) 00010000:00010000:3.0:1787380421.522999:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380421.523002:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.523007:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.523061:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884313a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a2f expref: 35 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.523076:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884314f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a2f expref: 34 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.523094:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:3.0:1787380421.523096:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787380421.523099:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c400, rc 0) 00000100:00100000:3.0:1787380421.523205:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11526:x1874203915668096:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1485us (1965us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787380421.523213:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 195 00000100:00100000:0.0:1787380421.525749:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.526062:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915668224 00000100:00100000:2.0:1787380421.526071:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915668224 00000100:00100000:3.0:1787380421.526159:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 196 00000100:00100000:3.0:1787380421.526171:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11526:x1874203915668224:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:3.0:1787380421.526233:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.526249:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 34 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.526257:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.526289:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 34 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.526303:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 34 pid: 7761 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.526318:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935584768:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380421.526439:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380421.529411:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935584768:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380421.529742:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380421.530222:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.530316:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915668480 00000100:00100000:2.0:1787380421.530323:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915668480 00000100:00100000:2.0:1787380421.530410:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:2.0:1787380421.530419:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:5568:x1874203915668480:12345-192.168.206.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787380421.531219:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:5568:x1874203915668480:12345-192.168.206.14@tcp:35:ldlm_bl.0 Request processed in 790us (988us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787380421.531230:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:2.0:1787380421.533383:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.533557:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915668608 00000100:00100000:1.0:1787380421.533587:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915668608 00010000:00010000:1.0:1787380421.533626:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 36 pid: 7761 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.533830:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 75 00000100:00100000:1.0:1787380421.533841:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:2355:x1874203915668608:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380421.533856:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380421.533864:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 36 pid: 7761 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.533877:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 36 pid: 7761 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.533899:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843102 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a1a expref: 36 pid: 7761 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.533915:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:1.0:1787380421.533920:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.533930:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.533937:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.533966:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380421.534011:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:2355:x1874203915668608:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 172us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.534029:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 75 00010000:00010000:3.0:1787380421.534134:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534143:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534174:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534182:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534189:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534196:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ca00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.534200:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534207:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534217:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:3.0:1787380421.534220:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380421.534224:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.534231:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884315d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.534294:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11526:x1874203915668224:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 8126us (8552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380421.534303:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 196 00000100:00100000:1.0:1787380421.537096:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380421.537199:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915668864 00000100:00100000:0.0:1787380421.537208:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915668864 00000100:00100000:0.0:1787380421.537310:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:0.0:1787380421.537321:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+34:11526:x1874203915668864:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380421.537849:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:11526:x1874203915668864:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 528us (760us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787380421.537858:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:0.0:1787380421.615272:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.615391:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915669120 00000100:00100000:1.0:1787380421.615400:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915669120 00000100:00100000:1.0:1787380421.615461:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 197 00000100:00100000:1.0:1787380421.615471:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+35:11537:x1874203915669120:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:1.0:1787380421.615508:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.615528:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a36 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615597:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615612:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615623:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615636:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615644:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615650:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615950:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118843179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615966:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118843179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.615974:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118843179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380421.615984:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787380421.616081:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616090:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616097:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616103:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380421.616107:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616115:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616127:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380421.616130:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380421.616134:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616140:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d11884316b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616152:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616165:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616171:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616177:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fc00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380421.616180:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616187:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616195:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d700) 00010000:00010000:1.0:1787380421.616197:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380421.616200:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616206:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616246:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a36 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616259:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118843179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a36 expref: 37 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.616266:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:1.0:1787380421.616268:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380421.616276:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f200, rc 0) 00000100:00100000:1.0:1787380421.616388:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:11537:x1874203915669120:12345-192.168.206.14@tcp:101:cat.0 Request processed in 918us (1124us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787380421.616396:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 197 00000100:00100000:1.0:1787380421.621185:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.621281:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915669376 00000100:00100000:2.0:1787380421.621291:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915669376 00000100:00100000:2.0:1787380421.621404:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:2.0:1787380421.621415:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:11537:x1874203915669376:12345-192.168.206.14@tcp:35:cat.0 00000100:00100000:2.0:1787380421.622119:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:11537:x1874203915669376:12345-192.168.206.14@tcp:35:cat.0 Request processed in 704us (942us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787380421.622130:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:2.0:1787380421.644203:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.644371:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915669632 00000100:00100000:1.0:1787380421.644381:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915669632 00000100:00100000:1.0:1787380421.644441:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 198 00000100:00100000:1.0:1787380421.644451:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:11538:x1874203915669632:12345-192.168.206.14@tcp:36:rm.0 00010000:00010000:1.0:1787380421.644527:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787380421.644554:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d118843179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a36 expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644582:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884314f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a2f expref: 37 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644596:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a21 expref: 36 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644606:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911db00) 00010000:00010000:1.0:1787380421.644620:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380421.644638:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644650:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644659:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644684:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644692:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644698:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644974:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644983:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.644991:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380421.646724:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:1.0:1787380421.646800:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646813:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646822:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646830:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646835:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646849:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646878:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380421.646899:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646905:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646910:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646915:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380421.646919:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646926:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646938:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911d500) 00010000:00010000:1.0:1787380421.646941:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787380421.646945:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646950:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843195 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646967:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646973:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646985:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.646990:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fa00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380421.646993:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.647000:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.647008:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380421.647010:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380421.647013:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.647019:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d118843187 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380421.647029:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c03147a2 reply state 0000000010d64080 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.647038:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380421.647142:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+37:11538:x1874203915669632:12345-192.168.206.14@tcp:36:rm.0 Request processed in 2689us (2943us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787380421.647150:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 198 00010000:00010000:0.0:1787380421.647232:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380421.647240:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.647245:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380421.647249:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.647265:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.647274:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d968911d500) 00010000:00010000:0.0:1787380421.647276:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787380421.647279:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.647283:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d11884319c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.647298:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380421.647300:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380421.647301:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380421.650007:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.650023:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.650030:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.650035:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fc00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380421.650039:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.650058:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.650075:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d700) 00010000:00010000:2.0:1787380421.650078:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380421.650082:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.650087:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884318e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.692087:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.692601:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915669888 00000100:00100000:1.0:1787380421.692611:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915669888 00000100:00100000:1.0:1787380421.692667:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 199 00000100:00100000:1.0:1787380421.692677:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+36:11544:x1874203915669888:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380421.692716:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.692738:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188431a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a3d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.692856:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.692870:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.692882:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.692895:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.692903:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.692910:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787380421.693537:0:5787:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787380421.693688:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693698:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693706:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693752:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693760:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693766:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693772:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380421.693776:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693784:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693795:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380421.693798:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380421.693802:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693808:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380421.693820:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab622e16 reply state 0000000081dd22a9 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.693829:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787380421.693857:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188431a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 39 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693884:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 38 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.693891:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380421.693894:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380421.693896:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f200, rc 0) 00000100:00100000:1.0:1787380421.693968:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+39:11544:x1874203915669888:12345-192.168.206.14@tcp:101:bash.0 Request processed in 1292us (1890us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1787380421.693976:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 199 00000100:00100000:0.0:1787380421.702803:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.703247:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915670016 00000100:00100000:1.0:1787380421.703266:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915670016 00000100:00080000:0.0:1787380421.703463:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380421.703512:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:1.0:1787380421.703523:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2355:x1874203915670016:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380421.703541:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.703563:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a44 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380421.703590:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787380421.703608:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:1.0:1787380421.703613:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380421.703621:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.703639:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.703670:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fa00, rc 0) 00000100:00100000:1.0:1787380421.703734:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915670016:12345-192.168.206.14@tcp:101:bash.0 Request processed in 212us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.703741:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 59 00010000:00010000:3.0:1787380421.706122:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706138:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706146:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706152:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380421.706156:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706164:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706179:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911db00) 00010000:00010000:3.0:1787380421.706182:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380421.706186:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706192:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188431b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.706590:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380421.706750:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915670144 00000100:00100000:3.0:1787380421.706759:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915670144 00000100:00100000:3.0:1787380421.706813:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:3.0:1787380421.706834:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:11544:x1874203915670144:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380421.706852:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380421.706870:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a4b expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706899:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706907:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380421.706911:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380421.706916:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706946:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.706958:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 7 pid: 6576 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.706972:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95865a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1874203935584896:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380421.707073:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380421.709883:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.709951:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915670272 00000100:00100000:1.0:1787380421.709959:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915670272 00010000:00010000:1.0:1787380421.709995:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 8 pid: 6576 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.710037:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:1.0:1787380421.710056:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915670272:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380421.710072:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380421.710095:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 8 pid: 6576 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.710107:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 8 pid: 6576 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.710133:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380421.710137:0:5771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380421.710145:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.710175:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.710209:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.710223:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5771:1874203935585024:192.168.206.14@tcp:105: 00000100:00100000:1.0:1787380421.710306:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a039dcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787380421.712454:0:6578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d1188431c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a44 expref: 8 pid: 6576 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.712476:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95865a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6578:1874203935584896:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380421.712526:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 7 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.712541:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380421.712607:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:11544:x1874203915670144:12345-192.168.206.14@tcp:101:bash.0 Request processed in 5773us (6019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380421.712615:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:1.0:1787380421.714565:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5123480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5771:1874203935585024:192.168.206.14@tcp:105: 00010000:00010000:1.0:1787380421.714598:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380421.714655:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915670272:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 4609us (4779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.714665:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:0.0:1787380421.716668:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.716763:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915670528 00000100:00100000:2.0:1787380421.716771:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915670528 00000100:00100000:2.0:1787380421.716824:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:2.0:1787380421.716833:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+38:11544:x1874203915670528:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:2.0:1787380421.717168:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+39:11544:x1874203915670528:12345-192.168.206.14@tcp:35:bash.0 Request processed in 334us (506us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787380421.717191:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:2.0:1787380421.878949:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380421.879038:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915670656 00000100:00100000:3.0:1787380421.879058:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915670656 00000100:00100000:3.0:1787380421.879120:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 200 00000100:00100000:3.0:1787380421.879130:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+39:11560:x1874203915670656:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380421.879153:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380421.879172:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d1188431d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a52 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.879227:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188431db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.879241:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188431db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.879252:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188431db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380421.879308:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787380421.879312:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380421.879332:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188431db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.879441:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d1188431d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a52 expref: 41 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.879458:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188431db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a52 expref: 40 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.879467:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:3.0:1787380421.879470:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380421.879473:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ce00, rc 0) 00000100:00100000:3.0:1787380421.879538:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11560:x1874203915670656:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 409us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380421.879546:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 200 00000100:00100000:1.0:1787380421.880137:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935585152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380421.880183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380421.880511:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935585152 00000100:00100000:0.0:1787380421.880518:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935585152 00000100:00100000:0.0:1787380421.880574:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787380421.880583:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935585152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380421.880615:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380421.880675:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935585152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380421.880682:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787380421.880859:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5159c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935585152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380421.884844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.885031:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915670912 00000100:00100000:1.0:1787380421.885042:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915670912 00000100:00100000:1.0:1787380421.885115:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 201 00000100:00100000:1.0:1787380421.885124:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+40:11560:x1874203915670912:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380421.885144:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.885163:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a59 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.885273:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188431e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.885287:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188431e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.885299:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188431e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380421.885311:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787380421.885515:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188431e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a59 expref: 43 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.885534:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188431e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a59 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.885553:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380421.885557:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380421.885561:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fa00, rc 0) 00000100:00100000:1.0:1787380421.885961:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+42:11560:x1874203915670912:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 836us (1125us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787380421.885970:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 201 00000100:00100000:2.0:1787380421.891793:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.891836:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.891905:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915671296 00000100:00100000:1.0:1787380421.891914:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915671296 00000100:00100000:1.0:1787380421.891979:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:1.0:1787380421.891989:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+42:2355:x1874203915671296:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380421.892004:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380421.892055:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d1188431e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a59 expref: 42 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.892073:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380421.892078:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380421.892138:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:2355:x1874203915671296:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 151us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.892146:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:3.0:1787380421.892702:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915671168 00000100:00100000:3.0:1787380421.892708:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915671168 00000100:00100000:3.0:1787380421.892751:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 202 00000100:00100000:3.0:1787380421.892759:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+41:11560:x1874203915671168:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380421.892780:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380421.892796:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d1188431f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a60 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.892886:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188431fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.892898:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188431fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.892909:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188431fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380421.892930:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787380421.893043:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d1188431f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a60 expref: 44 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.893071:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188431fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a60 expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.893079:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911d400) 00010000:00010000:3.0:1787380421.893082:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787380421.893084:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d800, rc 0) 00000100:00100000:3.0:1787380421.893126:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:11560:x1874203915671168:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 368us (1344us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1787380421.893133:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 202 00000100:00100000:2.0:1787380421.903235:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.905174:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915671424 00000100:00100000:1.0:1787380421.905187:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915671424 00000100:00100000:1.0:1787380421.905356:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:1.0:1787380421.905437:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+6:2355:x1874203915671424:12345-192.168.206.14@tcp:1:lfs.0 00010000:00010000:1.0:1787380421.905493:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.905513:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.905521:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380421.905525:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380421.905530:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.905566:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 6 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.905579:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 6 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.905608:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1874203935585280:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380421.905742:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a039dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380421.909719:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380421.910093:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915671552 00000100:00100000:0.0:1787380421.910102:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915671552 00002000:00100000:0.0:1787380421.910146:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d96bd0a2d80 x1874203915671552/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:227/0 lens 504/0 e 0 to 0 dl 1787380432 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380421.910156:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bd0a2d80 with x1874203915671552 ext(0->8) 00010000:00010000:0.0:1787380421.910165:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 7 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.910180:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 7 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380421.910188:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96bd0a2d80 00000100:00100000:0.0:1787380421.910224:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:0.0:1787380421.910233:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915671552:12345-192.168.206.14@tcp:4:lfs.0 00000100:00100000:0.0:1787380421.910781:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2355:x1874203915671552:12345-192.168.206.14@tcp:4:lfs.0 Request processed in 544us (1065us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787380421.910789:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00002000:00100000:0.0:1787380421.910797:0:6583:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d96bd0a2d80 x1874203915671552/t4294967308(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:227/0 lens 504/448 e 0 to 0 dl 1787380432 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380421.910805:0:6583:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96bd0a2d80 with x1874203915671552 ext(0->8) 00010000:00010000:0.0:1787380421.910812:0:6583:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 9 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380421.910835:0:6583:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 9 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380421.910842:0:6583:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d96bd0a2d80 00000100:00100000:1.0:1787380421.911602:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6576:1874203935585280:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380421.911625:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.914755:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.919521:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915671680 00000100:00100000:2.0:1787380421.919534:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915671680 00010000:00010000:2.0:1787380421.919581:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 9 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.919616:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 77 00000100:00100000:2.0:1787380421.919625:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2354:x1874203915671680:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380421.919640:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787380421.919659:0:5772:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787380421.919662:0:5772:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787380421 00002000:00010000:2.0:1787380421.919664:0:5772:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787380421 00002000:00010000:2.0:1787380421.919666:0:5772:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787380421 00010000:00010000:2.0:1787380421.919672:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 9 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.919685:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 9 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.919710:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010651c4c/0x651a07d1188431cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a4b expref: 9 pid: 6578 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.919745:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380421.919749:0:5772:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380421.919754:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.919764:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.919797:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380421.919855:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2354:x1874203915671680:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 231us (5107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380421.919862:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 77 00010000:00010000:1.0:1787380421.920065:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920075:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920099:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920107:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920115:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920122:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fa00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380421.920126:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920148:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920160:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.920168:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073e98ee6/0x651a07d11884320c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380421.920213:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915671424:12345-192.168.206.14@tcp:1:lfs.0 Request processed in 14848us (16987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.920222:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:3.0:1787380421.922966:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380421.923741:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915671936 00000100:00100000:2.0:1787380421.923752:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915671936 00000100:00100000:2.0:1787380421.923854:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:2.0:1787380421.923864:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f139450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+43:11560:x1874203915671936:12345-192.168.206.14@tcp:35:lfs.0 00000004:00010000:2.0:1787380421.923936:0:5789:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188431fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a60 expref: 43 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380421.924187:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787380421.924231:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787380421.924595:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1787380421.924649:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.924663:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 47 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.924685:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.924719:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 47 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.924734:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 47 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.924749:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd0a1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1874203935585408:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380421.924839:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380421.932221:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380421.932265:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915672064 00000100:00100000:3.0:1787380421.932274:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915672064 00010000:00010000:3.0:1787380421.932307:0:5771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 48 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380421.932377:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:3.0:1787380421.932387:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:2355:x1874203915672064:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380421.932401:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380421.932407:0:5771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 48 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.932439:0:5771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 48 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.932460:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911d400) 00010000:00010000:3.0:1787380421.932465:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.932474:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.932491:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380421.932511:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380421.932813:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+48:2355:x1874203915672064:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 184us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380421.932823:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 78 00010000:00010000:2.0:1787380421.933284:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188431b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a3d expref: 47 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.933300:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd0a1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5789:1874203935585408:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380421.933319:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.933332:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.933352:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380421.933684:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1787380421.935281:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787380421.935471:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd0a1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935585536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787380421.935548:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380421.935840:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935585536 00000100:00100000:3.0:1787380421.935847:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935585536 00000100:00100000:3.0:1787380421.935895:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380421.935904:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1874203935585536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787380421.936107:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1874203935585536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 204us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380421.936115:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380421.936171:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317780 going to sleep for 11 seconds 00000100:00100000:2.0:1787380421.936196:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd0a1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935585536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787380421.936775:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787380421.936841:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935585664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787380421.936876:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380421.936951:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689317a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380421.938219:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935585664 00000100:00100000:1.0:1787380421.938229:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935585664 00000100:00100000:1.0:1787380421.938287:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380421.938297:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1874203935585664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787380421.938824:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5789:x1874203935585664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 527us (1945us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787380421.938833:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380421.938943:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5237800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5789:1874203935585664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787380421.939015:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787380421.939072:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.939082:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.939089:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.939095:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380421.939100:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.939107:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.939122:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911d400) 00010000:00010000:2.0:1787380421.939125:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787380421.939129:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380421.939152:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843213 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380421.939327:0:5789:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787380421.939486:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787380421.939497:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372251157579ns, next at 373251155654ns, rc = 0 00000001:00080000:2.0:1787380421.939504:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787380421.939539:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911d400) 00010000:00010000:2.0:1787380421.939542:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380421.939549:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188431fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a60 expref: 51 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380421.939655:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f139450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:11560:x1874203915671936:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 15792us (16697us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787380421.939664:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 56 00000020:00080000:2.0:1787380421.939668:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787380421.941869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380421.941953:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915672192 00000100:00100000:1.0:1787380421.941962:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915672192 00000100:00100000:1.0:1787380421.942163:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 203 00000100:00100000:1.0:1787380421.942175:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+50:11560:x1874203915672192:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380421.942199:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380421.942230:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d11884321a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a67 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.942299:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d11884321a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a67 expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.942312:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d11884321a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a67 expref: 51 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380421.942331:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380421.942334:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380421.942461:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fa00, rc 0) 00000100:00100000:1.0:1787380421.942794:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:11560:x1874203915672192:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 621us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380421.942802:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 203 00000100:00100000:3.0:1787380421.945752:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380421.946265:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915672448 00000100:00100000:0.0:1787380421.946276:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915672448 00000100:00100000:2.0:1787380421.946448:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:2.0:1787380421.946461:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+51:11560:x1874203915672448:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:2.0:1787380421.946708:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11560:x1874203915672448:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 249us (966us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787380421.946716:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:3.0:1787380422.049212:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380422.049418:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915672576 00000100:00100000:1.0:1787380422.049430:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915672576 00000100:00100000:1.0:1787380422.049516:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 204 00000100:00100000:1.0:1787380422.049529:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11570:x1874203915672576:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:1.0:1787380422.049752:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049774:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049787:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049802:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049818:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049824:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049947:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049955:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.049963:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380422.050013:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050028:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050036:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050056:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050063:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380422.050068:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050077:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050097:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380422.050099:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380422.050106:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050111:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050127:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050133:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050138:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050143:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380422.050146:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050152:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050159:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968911d900) 00010000:00010000:1.0:1787380422.050161:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380422.050164:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050169:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050200:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050207:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050213:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050218:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fc00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380422.050221:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050228:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.050236:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380422.050239:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380422.050242:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.054223:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d11884322f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380422.055832:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11570:x1874203915672576:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 4952us (5279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380422.055850:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 204 00000100:00100000:3.0:1787380422.112202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380422.112382:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915672832 00000100:00100000:0.0:1787380422.112395:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915672832 00000100:00100000:0.0:1787380422.112462:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 205 00000100:00100000:0.0:1787380422.112471:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+52:11573:x1874203915672832:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380422.112674:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380422.112703:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118843236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a6e expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.112788:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.112804:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.112818:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.112834:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.112842:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.112871:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.113035:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.113059:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.113067:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380422.113079:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787380422.113201:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.113210:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.113217:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.113224:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380422.113228:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.113236:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114210:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:0.0:1787380422.114221:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380422.114247:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114755:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d11884323d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114780:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114788:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114795:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114802:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380422.114806:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114813:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114829:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d96991e8e00) 00010000:00010000:0.0:1787380422.114832:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380422.114836:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114842:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114917:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d118843236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 55 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114949:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 54 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.114957:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:0.0:1787380422.114960:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380422.114963:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f400, rc 0) 00000100:00100000:0.0:1787380422.117051:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:11573:x1874203915672832:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 4556us (4839us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787380422.117068:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 205 00000100:00100000:3.0:1787380422.120989:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380422.121908:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915672960 00000100:00100000:2.0:1787380422.121923:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915672960 00000100:00100000:2.0:1787380422.121999:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 206 00000100:00100000:2.0:1787380422.122009:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:11573:x1874203915672960:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:2.0:1787380422.122098:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122134:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122159:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122215:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122222:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122229:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122235:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380422.122260:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122269:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122281:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380422.122284:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380422.122288:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.122295:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2600/0x651a07d118843259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380422.123526:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:11573:x1874203915672960:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 1505us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380422.123553:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 206 00000100:00100000:3.0:1787380422.129146:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380422.129323:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915673216 00000100:00100000:2.0:1787380422.129378:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915673216 00000100:00100000:2.0:1787380422.129450:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:2.0:1787380422.129463:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+54:11573:x1874203915673216:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:2.0:1787380422.129780:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11573:x1874203915673216:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 320us (649us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787380422.129790:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 58 00010000:00010000:0.0:1787380422.136215:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380422.225465:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380422.225547:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915673472 00000100:00100000:1.0:1787380422.225560:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915673472 00000100:00100000:1.0:1787380422.225633:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 207 00000100:00100000:1.0:1787380422.225663:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11583:x1874203915673472:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380422.225694:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380422.225698:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787380422.225733:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188431db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a52 expref: 55 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.225759:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380422.225765:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380422.225781:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843260 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a75 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.225920:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.225935:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 55 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.225944:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.225983:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 55 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.225998:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 55 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380422.226014:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935585792:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380422.226141:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a039dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380422.237648:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935585792:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380422.237690:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380422.242188:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380422.243110:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915673600 00000100:00100000:2.0:1787380422.243125:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915673600 00010000:00010000:2.0:1787380422.243186:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 56 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380422.243242:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:2.0:1787380422.243328:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:2355:x1874203915673600:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380422.243408:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380422.243605:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 56 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.243630:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 56 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.243659:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884324b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a6e expref: 56 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.243680:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380422.243702:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.243713:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.243721:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.243757:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380422.243907:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.243917:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380422.243942:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787380422.244157:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843260 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 57 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.244174:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 56 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.244182:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380422.244185:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380422.244188:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:2.0:1787380422.244305:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+56:2355:x1874203915673600:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 1052us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380422.244315:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:1.0:1787380422.245714:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11583:x1874203915673472:12345-192.168.206.14@tcp:101:bash.0 Request processed in 20043us (20251us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1787380422.245727:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 207 00000100:00100000:3.0:1787380422.252462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380422.252722:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915673856 00000100:00100000:1.0:1787380422.252734:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915673856 00000100:00100000:1.0:1787380422.252806:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 208 00000100:00100000:1.0:1787380422.252818:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+55:11583:x1874203915673856:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:1.0:1787380422.253209:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.253239:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.253254:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380422.253314:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1787380422.253363:0:5786:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000049d1bef reply state 000000006680e729 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380422.253375:0:5786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380422.253717:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11583:x1874203915673856:12345-192.168.206.14@tcp:36:bash.0 Request processed in 897us (1271us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787380422.253727:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 208 00000020:00080000:1.0:1787380422.253738:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787380422.257410:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.257441:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.257449:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.257457:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fc00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380422.257462:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.257470:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.257492:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380422.257496:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380422.257501:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.257527:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d118843275 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380422.258422:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380422.258603:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915673984 00000100:00100000:0.0:1787380422.258619:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915673984 00000100:00100000:0.0:1787380422.258699:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 209 00000100:00100000:0.0:1787380422.258711:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11583:x1874203915673984:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:0.0:1787380422.258742:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380422.258764:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884327c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a7c expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.258870:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.258885:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.258894:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.259151:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 58 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.259167:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 58 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380422.259184:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5158000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935585920:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380422.259290:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d15000 going to sleep for 11 seconds 00000100:00100000:0.0:1787380422.265896:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380422.266217:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5158000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935585920:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380422.266244:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380422.267170:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915674112 00000100:00100000:1.0:1787380422.267180:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915674112 00010000:00010000:1.0:1787380422.267220:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 59 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380422.267268:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:1.0:1787380422.267278:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:2355:x1874203915674112:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380422.267294:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380422.267301:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 59 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.267316:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 59 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.267395:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843267 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a75 expref: 59 pid: 5787 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.267411:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380422.267416:0:11008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.267425:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.267432:0:11008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.267455:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380422.267512:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:2355:x1874203915674112:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 235us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380422.267520:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 80 00010000:00010000:0.0:1787380422.267640:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.267649:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380422.267694:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787380422.267699:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380422.267719:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.267751:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884327c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 58 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.267780:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 57 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.267788:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:0.0:1787380422.267792:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380422.267804:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f000, rc 0) 00000100:00100000:0.0:1787380422.267863:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11583:x1874203915673984:12345-192.168.206.14@tcp:101:bash.0 Request processed in 9154us (9451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380422.267870:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 209 00000100:00100000:0.0:1787380422.273439:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380422.273629:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915674368 00000100:00100000:2.0:1787380422.273641:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915674368 00000100:00100000:2.0:1787380422.273702:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:2.0:1787380422.273713:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+57:11583:x1874203915674368:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:2.0:1787380422.274267:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11583:x1874203915674368:12345-192.168.206.14@tcp:35:bash.0 Request processed in 553us (836us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787380422.274277:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:3.0:1787380422.328514:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380422.328668:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915674496 00000100:00100000:1.0:1787380422.328678:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915674496 00000100:00100000:1.0:1787380422.328798:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 210 00000100:00100000:1.0:1787380422.328808:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+58:11589:x1874203915674496:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380422.328831:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380422.328851:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d11884328a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a83 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.328910:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.328942:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.328955:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380422.329013:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787380422.329018:0:5786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380422.329039:0:5786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.329140:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d11884328a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a83 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.329157:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a83 expref: 59 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.329165:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:1.0:1787380422.329167:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380422.329171:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fe00, rc 0) 00000100:00100000:1.0:1787380422.329232:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11589:x1874203915674496:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 424us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380422.329239:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 210 00000100:00100000:2.0:1787380422.331836:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380422.331947:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915674624 00000100:00100000:3.0:1787380422.331959:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915674624 00000100:00100000:3.0:1787380422.332041:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 211 00000100:00100000:3.0:1787380422.332064:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11589:x1874203915674624:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380422.332090:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380422.332116:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843298 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a8a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332196:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332213:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332227:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332443:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332453:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332460:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332821:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188432ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332833:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188432ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332840:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188432ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380422.332885:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787380422.332890:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380422.332913:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188432ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332926:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188432ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332935:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332942:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332960:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332967:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380422.332973:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332981:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.332996:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:3.0:1787380422.332999:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380422.333004:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333010:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d11884329f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333028:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333034:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333040:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333057:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380422.333060:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333076:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333084:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968727f100) 00010000:00010000:3.0:1787380422.333087:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380422.333090:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333095:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d1188432a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333145:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843298 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a8a expref: 61 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333161:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188432ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a8a expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380422.333170:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:3.0:1787380422.333173:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380422.333176:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216c800, rc 0) 00000100:00100000:3.0:1787380422.333275:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11589:x1874203915674624:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1213us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380422.333285:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 211 00000100:00100000:3.0:1787380422.336731:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380422.336826:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915674752 00000100:00100000:1.0:1787380422.336845:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915674752 00000100:00100000:1.0:1787380422.336917:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:1.0:1787380422.336927:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9689c51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:2354:x1874203915674752:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380422.336943:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380422.336986:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c800/0x651a07d1188432ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a8a expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.337006:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380422.337011:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380422.337087:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9689c51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:2354:x1874203915674752:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 161us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380422.337095:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:3.0:1787380422.337289:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380422.337942:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915675008 00000100:00100000:1.0:1787380422.337950:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915675008 00000100:00100000:1.0:1787380422.338002:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 212 00000100:00100000:1.0:1787380422.338010:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11589:x1874203915675008:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380422.338026:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380422.338054:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188432b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a91 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.338145:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.338160:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 60 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.338168:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.338200:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 60 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.338225:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 60 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380422.338248:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935586048:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380422.338328:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968b596a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380422.342628:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5786:1874203935586048:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380422.342658:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380422.342867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380422.343083:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915675136 00000100:00100000:2.0:1787380422.343093:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915675136 00010000:00010000:2.0:1787380422.343145:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 61 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380422.343195:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 81 00000100:00100000:2.0:1787380422.343207:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:2355:x1874203915675136:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380422.343226:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380422.343234:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 61 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.343249:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 61 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.343276:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a7c expref: 61 pid: 7761 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.343315:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380422.343321:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.343331:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.343790:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.343861:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380422.343936:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:2355:x1874203915675136:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 730us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380422.343945:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 81 00010000:00010000:1.0:1787380422.343994:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.344004:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380422.344026:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787380422.344293:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188432b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.344883:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 60 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380422.344892:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380422.344895:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380422.344897:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e600, rc 0) 00000100:00100000:1.0:1787380422.344943:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11589:x1874203915675008:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 6934us (7656us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1787380422.344951:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 212 00000100:00100000:3.0:1787380422.347784:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380422.347903:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915675392 00000100:00100000:0.0:1787380422.347915:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915675392 00000100:00100000:0.0:1787380422.347995:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:0.0:1787380422.348007:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11589:x1874203915675392:12345-192.168.206.14@tcp:103:lfs.0 00010000:00010000:0.0:1787380422.348026:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380422.348071:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fa00/0x651a07d11884321a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a67 expref: 60 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.348094:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:0.0:1787380422.348100:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380422.348203:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11589:x1874203915675392:12345-192.168.206.14@tcp:103:lfs.0 Request processed in 198us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380422.348212:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:3.0:1787380422.355951:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380422.356286:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915675520 00000100:00100000:2.0:1787380422.356299:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915675520 00000100:00100000:2.0:1787380422.356578:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 213 00000100:00100000:2.0:1787380422.356592:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11589:x1874203915675520:12345-192.168.206.14@tcp:58:lfs.0 00010000:00010000:2.0:1787380422.356732:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.356752:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380422.356765:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380422.358025:0:7761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787380422.358595:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11589:x1874203915675520:12345-192.168.206.14@tcp:58:lfs.0 Request processed in 1996us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380422.358636:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 213 00000100:00100000:3.0:1787380422.363828:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380422.364198:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915675648 00000100:00100000:0.0:1787380422.364210:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915675648 00000100:00100000:0.0:1787380422.364748:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 214 00000100:00100000:0.0:1787380422.364762:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+59:11589:x1874203915675648:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380422.364791:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380422.364817:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a98 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.364887:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.364916:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 60 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.364939:0:5788:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.364956:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 60 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.364972:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:0.0:1787380422.364975:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380422.365156:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 60 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380422.365168:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e600, rc 0) 00000100:00100000:0.0:1787380422.365587:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11589:x1874203915675648:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 487us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380422.365600:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 214 00000004:00080000:0.0:1787380422.905719:0:6681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373217377564ns, next at 374217374099ns, rc = 0 00000100:00100000:3.0:1787380422.905744:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380422.905785:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935586176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380422.906166:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380422.906403:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935586176 00000100:00100000:1.0:1787380422.906427:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935586176 00000100:00100000:1.0:1787380422.906506:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787380422.906516:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935586176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380422.906559:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380422.906607:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935586176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380422.906614:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787380422.906710:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380422.908261:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5158e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935586176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380423.024634:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.024681:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.024718:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.024755:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.024784:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915675904 00000100:00100000:3.0:1787380423.024793:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915675904 00000100:00100000:3.0:1787380423.024842:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915676032 00000100:00100000:3.0:1787380423.024846:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915676032 00000100:00100000:3.0:1787380423.024867:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 92 00000100:00100000:3.0:1787380423.024876:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2354:x1874203915675904:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380423.024944:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2354:x1874203915675904:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.024952:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 92 00000100:00100000:3.0:1787380423.024968:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 93 00000100:00100000:3.0:1787380423.024974:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915676032:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380423.024999:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915676032:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 24us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.025005:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 93 00000100:00100000:0.0:1787380423.025268:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915676160 00000100:00100000:0.0:1787380423.025273:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915676160 00000100:00100000:0.0:1787380423.025320:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 157 00000100:00100000:0.0:1787380423.025328:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915676160:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380423.025396:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915676160:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 69us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380423.025418:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 157 00000100:00080000:0.0:1787380423.025459:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380423.025464:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380423.025465:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380423.025666:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915675776 00000100:00100000:2.0:1787380423.025672:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915675776 00000100:00100000:2.0:1787380423.025709:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 296 00000100:00100000:2.0:1787380423.025717:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915675776:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380423.025747:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2353:x1874203915675776:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 32us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380423.025753:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 296 00000040:00080000:1.0:1787380423.032498:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380423.032508:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380423.032549:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787380423.032556:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380423.032683:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935586304:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380423.035898:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968b5960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380423.039268:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5121180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935586304:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380423.039801:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380423.042531:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915676288 00000100:00100000:1.0:1787380423.042545:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915676288 00000100:00100000:1.0:1787380423.042635:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 215 00000100:00100000:1.0:1787380423.042651:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11590:x1874203915676288:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787380423.042681:0:5786:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787380423.042860:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11590:x1874203915676288:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 211us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380423.042869:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 215 00000100:00080000:0.0:1787380423.043023:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380423.050120:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.050287:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915676416 00000100:00100000:3.0:1787380423.050308:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915676416 00000100:00100000:3.0:1787380423.050393:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 216 00000100:00100000:3.0:1787380423.050403:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11590:x1874203915676416:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787380423.050470:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050497:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050511:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050525:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050532:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050539:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050560:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050569:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050575:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380423.050610:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787380423.050614:0:5787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380423.050632:0:5787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050644:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050650:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050657:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050662:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ce00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380423.050666:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050674:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050685:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:3.0:1787380423.050688:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380423.050692:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050698:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188432d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050711:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050718:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050723:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050740:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380423.050742:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050748:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050755:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9d968727f100) 00010000:00010000:3.0:1787380423.050757:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380423.050759:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050765:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188432de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050780:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050785:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050790:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050794:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ca00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380423.050797:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050802:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050819:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:3.0:1787380423.050821:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380423.050824:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.050829:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188432e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.050906:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11590:x1874203915676416:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 Request processed in 504us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.050914:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 216 00000100:00100000:3.0:1787380423.058493:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380423.059012:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915676672 00000100:00100000:1.0:1787380423.059023:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915676672 00000100:00100000:1.0:1787380423.059098:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 217 00000100:00100000:1.0:1787380423.059108:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+60:11590:x1874203915676672:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380423.059126:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380423.059326:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188432ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6a9f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059505:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059521:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059535:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380423.059546:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787380423.059635:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059642:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059648:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059652:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ec00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380423.059656:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059662:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059672:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380423.059675:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787380423.059679:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059694:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188432f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059730:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188432ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a9f expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059739:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:1.0:1787380423.059741:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380423.059744:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d1188432ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a9f expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.059752:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:1.0:1787380423.059859:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11590:x1874203915676672:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 752us (1373us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1787380423.059867:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 217 00000100:00100000:0.0:1787380423.066677:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.066749:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915676800 00000100:00100000:3.0:1787380423.066757:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915676800 00000100:00100000:3.0:1787380423.066813:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 218 00000100:00100000:3.0:1787380423.066820:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11590:x1874203915676800:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380423.066851:0:5787:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380423.067048:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11590:x1874203915676800:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 218us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.067056:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 218 00000100:00100000:0.0:1787380423.072759:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380423.072855:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915677056 00000100:00100000:2.0:1787380423.072866:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915677056 00000100:00100000:2.0:1787380423.072928:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 219 00000100:00100000:2.0:1787380423.072938:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b515aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11590:x1874203915677056:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380423.072959:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380423.072962:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787380423.072987:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a83 expref: 61 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.073005:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380423.073010:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380423.073023:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843301 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6aa6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380423.073968:0:5788:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787380423.074963:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.074998:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.075010:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.075089:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843301 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aa6 expref: 63 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.075106:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aa6 expref: 62 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.075114:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d969371a800) 00010000:00010000:2.0:1787380423.075116:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380423.075119:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3200, rc 0) 00000100:00100000:2.0:1787380423.075194:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b515aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11590:x1874203915677056:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 2256us (2442us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787380423.075203:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 219 00000100:00100000:0.0:1787380423.086119:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380423.086219:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915677312 00000100:00100000:2.0:1787380423.086229:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915677312 00000100:00100000:2.0:1787380423.086423:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 220 00000100:00100000:2.0:1787380423.086433:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11590:x1874203915677312:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787380423.087802:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380423.087835:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3200/0x651a07d118843308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aa6 expref: 62 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.087854:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d969371a800) 00010000:00010000:2.0:1787380423.087876:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380423.087896:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.087907:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.087917:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.087929:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.087936:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.087943:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088015:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088022:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088028:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088034:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.088051:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088059:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088075:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380423.088078:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380423.088082:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088088:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3600/0x651a07d118843316 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088099:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088104:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088110:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088115:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2e00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.088118:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088123:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088130:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xefdb28c3 (ffff9d969371a000) 00010000:00010000:2.0:1787380423.088132:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380423.088135:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.088141:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2e00/0x651a07d11884331d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xefdb28c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380423.088230:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11590:x1874203915677312:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 1797us (2119us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380423.088239:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 220 00000100:00100000:0.0:1787380423.097808:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380423.098094:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915677440 00000100:00100000:1.0:1787380423.098103:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915677440 00000100:00100000:1.0:1787380423.098400:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 221 00000100:00100000:1.0:1787380423.098411:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+61:11590:x1874203915677440:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380423.098429:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380423.098449:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843324 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6aad expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.098490:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.098502:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.098525:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.098614:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 63 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.098630:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 62 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.098639:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:1.0:1787380423.098641:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380423.098644:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515ec00, rc 0) 00000100:00100000:1.0:1787380423.098711:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5158000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11590:x1874203915677440:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 302us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380423.098718:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 221 00000100:00100000:0.0:1787380423.103074:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.114629:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915677696 00000100:00100000:3.0:1787380423.114642:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915677696 00000100:00100000:0.0:1787380423.114826:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 222 00000100:00100000:0.0:1787380423.114836:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+62:11590:x1874203915677696:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787380423.114913:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.114928:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.114939:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787380423.115197:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1787380423.115295:0:5787:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000517fb3b8 reply state 000000006d53212b transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380423.115305:0:5787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380423.115749:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+64:11590:x1874203915677696:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 911us (12681us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787380423.115758:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 222 00000100:00100000:0.0:1787380423.139457:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.139783:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915677824 00000100:00100000:3.0:1787380423.139793:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915677824 00000100:00100000:3.0:1787380423.139851:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 223 00000100:00100000:3.0:1787380423.139860:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+64:11590:x1874203915677824:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380423.139885:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380423.139914:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ab4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.139970:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 65 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.139986:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 65 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.140005:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:3.0:1787380423.140009:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380423.140012:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380423.140081:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+65:11590:x1874203915677824:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 222us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.140090:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 223 00010000:00010000:2.0:1787380423.141261:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.141274:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.141282:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.141288:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.141292:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.141300:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.141315:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:2.0:1787380423.141318:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787380423.141322:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.141329:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380423.144334:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.144494:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915677952 00000100:00100000:3.0:1787380423.144504:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915677952 00000100:00100000:3.0:1787380423.144552:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:3.0:1787380423.144562:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2355:x1874203915677952:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787380423.144845:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2355:x1874203915677952:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 283us (518us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787380423.144854:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:0.0:1787380423.148822:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380423.149134:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915678208 00000100:00100000:2.0:1787380423.149153:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915678208 00000100:00100000:2.0:1787380423.149209:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:2.0:1787380423.149228:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+64:11590:x1874203915678208:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787380423.149500:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+65:11590:x1874203915678208:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 273us (684us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787380423.149508:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:0.0:1787380423.151836:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380423.152193:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915678464 00000100:00100000:2.0:1787380423.152202:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915678464 00000100:00100000:2.0:1787380423.152268:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 224 00000100:00100000:2.0:1787380423.152279:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+65:11590:x1874203915678464:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787380423.152664:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+65:11590:x1874203915678464:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 387us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380423.152673:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 224 00000100:00100000:1.0:1787380423.156768:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.156879:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915678592 00000100:00100000:3.0:1787380423.156888:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915678592 00000100:00100000:3.0:1787380423.156958:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 225 00000100:00100000:3.0:1787380423.156968:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+65:11590:x1874203915678592:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380423.156988:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380423.157019:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6abb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.157094:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118843347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.157108:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118843347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.157120:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118843347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380423.157165:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380423.157183:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118843347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.157207:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d118843340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6abb expref: 67 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.157227:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118843347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6abb expref: 66 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.157236:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:3.0:1787380423.157239:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787380423.157254:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ce00, rc 0) 00000100:00100000:3.0:1787380423.161728:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+66:11590:x1874203915678592:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 4750us (4956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.161741:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 225 00010000:00010000:0.0:1787380423.176694:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380423.179216:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380423.179562:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915678720 00000100:00100000:0.0:1787380423.179572:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915678720 00000100:00100000:0.0:1787380423.179633:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:0.0:1787380423.179644:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+10:2353:x1874203915678720:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380423.179662:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380423.179692:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ac2 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380423.179719:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8942c6, blocks: 0x1 00010000:00010000:0.0:1787380423.179738:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1787380423.179742:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380423.179750:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 11 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.179768:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 11 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.179781:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380423.179829:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:2353:x1874203915678720:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 187us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380423.179849:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:0.0:1787380423.191782:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.191870:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915678976 00000100:00100000:3.0:1787380423.191879:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915678976 00000100:00100000:3.0:1787380423.191955:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 226 00000100:00100000:3.0:1787380423.191965:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+66:11590:x1874203915678976:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787380423.192077:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+66:11590:x1874203915678976:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.192084:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 226 00000100:00100000:2.0:1787380423.195468:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.195593:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915679104 00000100:00100000:3.0:1787380423.195602:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915679104 00000100:00100000:3.0:1787380423.195655:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:3.0:1787380423.195664:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:11590:x1874203915679104:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380423.195679:0:6578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380423.195696:0:6578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ac9 expref: -99 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.195727:0:6578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 12 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.195736:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380423.195741:0:6578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380423.195746:0:6578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 12 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.195777:0:6578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 12 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.195791:0:6578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 12 pid: 6577 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.195824:0:6578:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1874203935586432:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380423.195915:0:6578:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380423.213424:0:6578:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5f35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6578:1874203935586432:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380423.213456:0:6578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 12 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.213485:0:6578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216de00, rc 0) 00000100:00100000:3.0:1787380423.213538:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:11590:x1874203915679104:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 17876us (18079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.213547:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:2.0:1787380423.213686:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380423.213894:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915679232 00000100:00100000:1.0:1787380423.213901:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915679232 00010000:00010000:1.0:1787380423.213930:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 12 pid: 6577 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380423.213963:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:1.0:1787380423.213971:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+12:2355:x1874203915679232:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380423.213984:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380423.214004:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 12 pid: 6577 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.214030:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 12 pid: 6577 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.214063:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d11884334e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac2 expref: 12 pid: 6577 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.214076:0:8292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380423.214080:0:8292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380423.214087:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.214097:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.214126:0:8292:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 11 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380423.214151:0:8292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8292:1874203935586560:192.168.206.14@tcp:105: 00000100:00100000:1.0:1787380423.214210:0:8292:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968b596b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380423.216167:0:8292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8292:1874203935586560:192.168.206.14@tcp:105: 00010000:00010000:1.0:1787380423.216188:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380423.216235:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:2355:x1874203915679232:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 2264us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380423.216252:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:0.0:1787380423.224314:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380423.224847:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915679360 00000100:00100000:2.0:1787380423.224857:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915679360 00002000:00100000:2.0:1787380423.224909:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9d96892efb80 x1874203915679360/t0(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:229/0 lens 504/0 e 0 to 0 dl 1787380434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787380423.224920:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96892efb80 with x1874203915679360 ext(0->12) 00002000:00010000:2.0:1787380423.224926:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96892efb80 00000100:00100000:2.0:1787380423.224957:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:2.0:1787380423.224966:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+11:2355:x1874203915679360:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787380423.226033:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2355:x1874203915679360:12345-192.168.206.14@tcp:4:lhsmtool_posix.0 Request processed in 1061us (1721us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787380423.226055:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00002000:00100000:2.0:1787380423.226072:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9d96892efb80 x1874203915679360/t4294967320(0) o4->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:229/0 lens 504/448 e 0 to 0 dl 1787380434 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787380423.226082:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d96892efb80 with x1874203915679360 ext(0->12) 00002000:00010000:2.0:1787380423.226086:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d96892efb80 00000100:00100000:3.0:1787380423.232590:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380423.232935:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915679488 00000100:00100000:2.0:1787380423.232945:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915679488 00000100:00100000:2.0:1787380423.233011:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 227 00000100:00100000:2.0:1787380423.233021:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+66:11590:x1874203915679488:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787380423.317910:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+66:11590:x1874203915679488:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 Request processed in 84881us (85319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380423.317923:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 227 00000001:00080000:2.0:1787380423.317960:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787380423.317972:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787380423.318032:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d9698d1fc00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787380423.318048:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9698d95100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d9698d1f3c0 00000020:00080000:2.0:1787380423.318051:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9698d95b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d96908a0400 00000001:00080000:2.0:1787380423.318071:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1787380423.318086:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787380423.318101:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d9689317780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787380423.318104:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d968b593400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d9689317180 00000020:00080000:2.0:1787380423.318107:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d968b593900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d9698f2f800 00000020:00080000:2.0:1787380423.318129:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787380423.318445:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787380423.318611:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787380423.318674:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935586688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787380423.318794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380423.319055:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380423.319063:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9688e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935586816:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787380423.319089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380423.319252:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935586688 00000100:00100000:1.0:1787380423.319259:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935586688 00000100:00100000:0.0:1787380423.319330:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935586816 00000100:00100000:0.0:1787380423.319335:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935586816 00000100:00080000:2.0:1787380423.319555:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380423.323209:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.323503:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915679616 00000100:00100000:3.0:1787380423.323512:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915679616 00000100:00100000:1.0:1787380423.323623:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787380423.323635:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935586688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787380423.323667:0:6577:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1787380423.323707:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8942c5, atime: 0x6a8942c5, ctime: 0x6a8942c5, blocks: 0x1 00010000:00010000:1.0:1787380423.323715:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.323730:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1787380423.323734:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380423.323741:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.323756:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.323765:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.323772:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.323791:0:6577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787380423.325691:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd43e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3301:x1874203935586688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2053us (6891us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787380423.325713:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1787380423.325826:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b5234000/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787380423.325833:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935586688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787380423.326470:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787380423.326487:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935586816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787380423.326516:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1787380423.326539:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.326559:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 13 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.326568:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787380423.326572:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380423.326577:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.326612:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 13 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.326626:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 13 pid: 6577 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380423.326639:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935586944:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380423.326728:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9698d1f840 going to sleep for 11 seconds 00010000:00010000:0.0:1787380423.328055:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380423.328066:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.328078:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e200 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380423.328083:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.328094:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.328114:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.328123:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a4037ec/0x651a07d11884335c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.328147:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380423.328149:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380423.328151:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380423.330987:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:3.0:1787380423.331005:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2356:x1874203915679616:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787380423.335128:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.335839:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935586944:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380423.335866:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380423.336372:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915679744 00000100:00100000:2.0:1787380423.336380:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915679744 00010000:00010000:2.0:1787380423.336417:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 14 pid: 6577 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380423.336461:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 83 00000100:00100000:2.0:1787380423.336470:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+14:2356:x1874203915679744:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380423.336929:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380423.336937:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 14 pid: 6577 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.336952:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 14 pid: 6577 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.336974:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb651160/0x651a07d11884311e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a28 expref: 14 pid: 6577 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.336989:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380423.336993:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380423.337008:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.337018:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.337051:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380423.337104:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+13:2356:x1874203915679744:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 635us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380423.337111:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 83 00010000:00010000:3.0:1787380423.340855:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.340873:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.340901:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.340910:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.340936:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380423.341972:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380423.341983:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.341994:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380423.341999:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.342009:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.342029:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.342036:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843363 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.342084:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380423.342086:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380423.342088:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380423.342191:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935586816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15707us (23096us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787380423.342208:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1787380423.342594:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d9688e7bb80/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787380423.342616:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9688e7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935586816:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787380423.406239:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:0.0:1787380423.406260:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1787380423.406269:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:3.0:1787380423.409297:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915679616:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 Request processed in 78288us (86084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.409312:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:0.0:1787380423.414159:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.414849:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915680000 00000100:00100000:3.0:1787380423.414860:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915680000 00000100:00100000:3.0:1787380423.414923:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 228 00000100:00100000:3.0:1787380423.414933:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:11590:x1874203915680000:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380423.414985:0:7761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380423.415011:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d118843347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6abb expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.415029:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:3.0:1787380423.415034:0:7761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380423.415074:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.415103:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.415112:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380423.415402:0:7761:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a4204e2 reply state 00000000193ed03d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.415412:0:7761:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380423.415516:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:11590:x1874203915680000:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 581us (1364us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1787380423.415523:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 228 00000100:00100000:2.0:1787380423.418273:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380423.420960:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915680128 00000100:00100000:0.0:1787380423.420990:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915680128 00000100:00100000:0.0:1787380423.421065:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:0.0:1787380423.421075:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915680128:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787380423.421287:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787380423.421291:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787380422 00002000:00010000:0.0:1787380423.421293:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787380421 00002000:00010000:0.0:1787380423.421295:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787380422 -> 1787380422 00002000:00010000:0.0:1787380423.421297:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787380423.421375:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698cebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915680128:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 301us (3110us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787380423.421383:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:2.0:1787380423.423856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.423921:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915680384 00000100:00100000:3.0:1787380423.423931:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915680384 00000100:00100000:3.0:1787380423.423989:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 229 00000100:00100000:3.0:1787380423.423998:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:11590:x1874203915680384:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787380423.424072:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.424088:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.424096:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.424128:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 21 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.424159:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 21 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.424173:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935587072:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380423.424268:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05bd80 going to sleep for 11 seconds 00010000:00010000:1.0:1787380423.426789:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.426810:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.426819:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.426825:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380423.426830:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.426838:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.426857:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:1.0:1787380423.426861:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380423.426866:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.426872:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c400/0x651a07d11884336a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.433745:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380423.433844:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915680512 00000100:00100000:1.0:1787380423.433854:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915680512 00010000:00010000:1.0:1787380423.433895:0:5772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 21 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380423.433937:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 84 00000100:00100000:1.0:1787380423.433962:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2356:x1874203915680512:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380423.433979:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380423.433986:0:5772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 21 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.433999:0:5772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 21 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.434020:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:1.0:1787380423.434025:0:5772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.434034:0:5772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.434054:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.434072:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380423.434137:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2356:x1874203915680512:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 176us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380423.434144:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 84 00010000:00010000:2.0:1787380423.434564:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d11884332b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aad expref: 20 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380423.434580:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5788:1874203935587072:192.168.206.14@tcp:104: 00010000:00010000:2.0:1787380423.434601:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434609:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434614:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434641:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434648:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434654:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434672:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.434676:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434683:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434693:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:2.0:1787380423.434696:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787380423.434699:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.434705:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d000/0x651a07d118843371 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380423.434760:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:11590:x1874203915680384:12345-192.168.206.14@tcp:55:lhsmtool_posix.0 Request processed in 10762us (10911us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787380423.434768:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 229 00000100:00100000:3.0:1787380423.438453:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380423.438754:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915680640 00000100:00100000:0.0:1787380423.438764:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915680640 00000100:00100000:0.0:1787380423.438819:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:0.0:1787380423.438828:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915680640:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787380423.438869:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.438890:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.438898:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380423.438903:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380423.438907:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.438940:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 8 pid: 6578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.438965:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 8 pid: 6578 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380423.438979:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935587200:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380423.439065:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380423.445620:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380423.445762:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915680768 00000100:00100000:1.0:1787380423.445772:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915680768 00010000:00010000:1.0:1787380423.445810:0:8292:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 9 pid: 6578 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380423.445850:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:1.0:1787380423.445859:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+9:2356:x1874203915680768:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380423.445886:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380423.445910:0:8292:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 9 pid: 6578 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.445924:0:8292:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 9 pid: 6578 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.445948:0:8292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380423.445953:0:8292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380423.445959:0:8292:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.445969:0:8292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.445990:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380423.446143:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897d32fe/0x651a07d118843355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ac9 expref: 9 pid: 6578 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.446160:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6576:1874203935587200:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380423.446180:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446190:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446197:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446233:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446249:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446265:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446273:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fe00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380423.446278:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446286:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446298:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.446305:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d118843378 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380423.446648:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2356:x1874203915680768:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 788us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380423.446657:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:3.0:1787380423.446962:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2355:x1874203915680640:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 Request processed in 8133us (8515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.446971:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:2.0:1787380423.452599:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380423.452695:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915681024 00000100:00100000:0.0:1787380423.452705:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915681024 00000100:00100000:0.0:1787380423.452801:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 230 00000100:00100000:0.0:1787380423.452814:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:11590:x1874203915681024:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787380423.452885:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.452902:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.452913:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.453110:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.453121:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.453128:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.453176:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.453189:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 20 pid: 5788 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380423.453202:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935587328:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380423.453647:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380423.458827:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380423.459068:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935587328:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380423.459097:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.461662:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915681152 00000100:00100000:3.0:1787380423.461676:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915681152 00010000:00010000:3.0:1787380423.461732:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 21 pid: 5788 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.461779:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 86 00000100:00100000:3.0:1787380423.461803:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2355:x1874203915681152:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380423.461817:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380423.461824:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 21 pid: 5788 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.461837:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 21 pid: 5788 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.461856:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d118843339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ab4 expref: 21 pid: 5788 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.461874:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:3.0:1787380423.461879:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.461888:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.461896:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.461917:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380423.461982:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:2355:x1874203915681152:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 181us (3163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.461989:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 86 00010000:00010000:0.0:1787380423.462171:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.462179:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380423.462378:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787380423.462534:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1787380423.462579:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787380423.462654:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935587456:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787380423.462834:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380423.462863:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380423.463596:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935587456 00000100:00100000:3.0:1787380423.463605:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935587456 00000100:00100000:3.0:1787380423.463644:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380423.463653:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1874203935587456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787380423.463767:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1874203935587456:12345-0@lo:1000:mdt00_001.0 Request processed in 114us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.463774:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787380423.466303:0:5787:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1787380423.466314:0:5787:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1787380423.466362:0:5787:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d9688e7bb80 x1874203935586816/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787380439 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380423.466393:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935587456:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787380423.467568:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1787380423.467659:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935587584:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787380423.467836:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380423.467909:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380423.468074:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935587584 00000100:00100000:3.0:1787380423.468081:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935587584 00000100:00100000:3.0:1787380423.468164:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787380423.468174:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1874203935587584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787380423.470999:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5787:x1874203935587584:12345-0@lo:1000:mdt00_001.0 Request processed in 2815us (3152us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1787380423.471014:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380423.471103:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5787:1874203935587584:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787380423.471145:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471157:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471164:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471187:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.471192:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471200:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471224:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d968911d900) 00010000:00010000:2.0:1787380423.471227:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380423.471231:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471237:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843386 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471817:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471825:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471831:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471836:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.471839:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471845:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471868:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380423.471871:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380423.471879:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 23 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471890:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 23 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471899:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 23 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.471949:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 23 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380423.471962:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935587712:192.168.206.14@tcp:105: 00000100:00100000:2.0:1787380423.472087:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380423.476045:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380423.476304:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5787:1874203935587712:192.168.206.14@tcp:105: 00010000:00010000:0.0:1787380423.476334:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476374:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3000/0x651a07d1188432c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476404:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476416:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476426:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476436:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476442:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476465:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476471:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380423.476475:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476491:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476502:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:0.0:1787380423.476505:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380423.476508:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476514:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f400/0x651a07d11884338d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476523:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476529:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476535:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476540:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380423.476543:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476556:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476564:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:0.0:1787380423.476566:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380423.476568:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.476574:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f200/0x651a07d11884337f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380423.476763:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:11590:x1874203915681024:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 23951us (24171us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1787380423.476772:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 230 00000020:00080000:0.0:1787380423.476777:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787380423.477212:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380423.477217:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380423.477859:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787380423.477869:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380423.478048:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915681280 00000100:00100000:3.0:1787380423.478057:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915681280 00000100:00100000:3.0:1787380423.478148:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:3.0:1787380423.478158:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:11589:x1874203915681280:12345-192.168.206.14@tcp:49:lfs.0 00000100:00100000:3.0:1787380423.478281:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:11589:x1874203915681280:12345-192.168.206.14@tcp:49:lfs.0 Request processed in 124us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.478288:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:1.0:1787380423.482791:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380423.482992:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380423.483062:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915681792 00000100:00100000:0.0:1787380423.483072:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915681792 00000100:00100000:0.0:1787380423.483127:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:0.0:1787380423.483139:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f13bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+23:11590:x1874203915681792:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787380423.484012:0:5790:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787380423.484130:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1787380423.484181:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.484197:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.484208:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.484229:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.484236:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.484242:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380423.484271:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380423.485176:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380423.485185:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.485195:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380423.485199:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.485217:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.485231:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d96991e8800) 00010000:00010000:1.0:1787380423.485234:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787380423.485238:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.485256:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f000/0x651a07d118843394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380423.485276:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380423.485278:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380423.485280:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380423.485321:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f13bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+25:11590:x1874203915681792:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 2181us (2324us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787380423.485331:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 62 00000020:00080000:0.0:1787380423.485365:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787380423.488034:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915681536 00000100:00100000:2.0:1787380423.488057:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915681536 00000100:00100000:2.0:1787380423.488120:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 231 00000100:00100000:2.0:1787380423.488130:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+25:11589:x1874203915681536:12345-192.168.206.14@tcp:58:lfs.0 00000040:00080000:2.0:1787380423.488422:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787380423.488718:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+25:11589:x1874203915681536:12345-192.168.206.14@tcp:58:lfs.0 Request processed in 587us (5933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380423.488726:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 231 00000100:00100000:1.0:1787380423.521726:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.522005:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915681920 00000100:00100000:3.0:1787380423.522014:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915681920 00000100:00100000:3.0:1787380423.522087:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 232 00000100:00100000:3.0:1787380423.522097:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+25:11593:x1874203915681920:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380423.522122:0:7761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380423.522140:0:7761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884339b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ad0 expref: -99 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522201:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522215:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522254:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522271:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522278:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522285:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522615:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522628:0:7761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522636:0:7761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522668:0:7761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 26 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.522693:0:7761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 26 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.522707:0:7761:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b521fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935587840:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380423.522777:0:7761:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f05b600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380423.531057:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380423.531154:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915682176 00000100:00100000:2.0:1787380423.531163:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915682176 00000100:00100000:2.0:1787380423.531229:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:2.0:1787380423.531239:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:5568:x1874203915682176:12345-192.168.206.14@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787380423.531513:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:5568:x1874203915682176:12345-192.168.206.14@tcp:35:ldlm_bl.0 Request processed in 275us (473us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787380423.531522:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 63 00000100:00100000:3.0:1787380423.532555:0:7761:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b521fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7761:1874203935587840:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380423.532779:0:7761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380423.536157:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380423.536830:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915682304 00000100:00100000:3.0:1787380423.536840:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915682304 00010000:00010000:3.0:1787380423.536881:0:11008:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 28 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.536924:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 87 00000100:00100000:3.0:1787380423.536934:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b52dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:2355:x1874203915682304:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380423.536948:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380423.536955:0:11008:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 28 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.536967:0:11008:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 28 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.536989:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188432bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a91 expref: 28 pid: 5786 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.537006:0:11008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:3.0:1787380423.537010:0:11008:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.537019:0:11008:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.537026:0:11008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380423.537086:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380423.537220:0:7761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537229:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380423.537285:0:7761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787380423.537289:0:7761:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380423.537309:0:7761:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537321:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537332:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537370:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537377:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537393:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ce00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.537398:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537406:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537417:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380423.537420:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380423.537424:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537431:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ce00/0x651a07d1188433a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537445:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537464:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.537470:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380423.537646:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b52dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:2355:x1874203915682304:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 712us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380423.537655:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 87 00010000:00010000:2.0:1787380423.538190:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380423.538195:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.538202:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.538225:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d968727f900) 00010000:00010000:2.0:1787380423.538228:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380423.538231:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.538247:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.538291:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d11884339b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ad0 expref: 27 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.538305:0:7761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ad0 expref: 26 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380423.538311:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380423.538314:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380423.538316:0:7761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d800, rc 0) 00000100:00100000:2.0:1787380423.538399:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:11593:x1874203915681920:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 16304us (16683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380423.538407:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 232 00010000:00010000:2.0:1787380424.184236:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380424.462427:0:12411:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380424.462436:0:12411:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380424.462492:0:12411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787380424.462496:0:12411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787380424.506996:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380424.507005:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380424.507053:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787380424.507059:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787380424.507185:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935587968:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380424.507276:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380424.546668:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380424.546739:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915682432 00000100:00100000:3.0:1787380424.546748:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915682432 00000100:00100000:3.0:1787380424.546811:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 233 00000100:00100000:3.0:1787380424.546821:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:11605:x1874203915682432:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380424.546856:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380424.546950:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+27:11605:x1874203915682432:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 130us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380424.546958:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 233 00000100:00100000:2.0:1787380424.547521:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11526:1874203935587968:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380424.573568:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380424.573687:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915682688 00000100:00100000:0.0:1787380424.573697:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915682688 00000100:00100000:0.0:1787380424.573759:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 234 00000100:00100000:0.0:1787380424.573769:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+26:11605:x1874203915682688:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380424.573793:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380424.573814:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d1188433b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ad7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380424.573907:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188433be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380424.573921:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188433be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380424.573933:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188433be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380424.573952:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787380424.574092:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1ee00/0x651a07d1188433b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ad7 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380424.574107:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188433be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ad7 expref: 28 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380424.574116:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:0.0:1787380424.574119:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380424.574123:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f600, rc 0) 00000100:00100000:0.0:1787380424.574173:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:11605:x1874203915682688:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 406us (615us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787380424.574180:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 234 00000100:00100000:1.0:1787380424.582917:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380424.582983:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915682944 00000100:00100000:3.0:1787380424.582992:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915682944 00000100:00100000:3.0:1787380424.583055:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 235 00000100:00100000:3.0:1787380424.583066:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:11605:x1874203915682944:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787380424.583142:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583158:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583169:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583397:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583405:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583411:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583417:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216ca00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380424.583421:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583429:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583441:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:3.0:1787380424.583444:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380424.583448:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.583454:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216ca00/0x651a07d1188433cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380424.583609:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95865a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:11605:x1874203915682944:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 543us (699us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787380424.583617:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 235 00000040:00080000:2.0:1787380424.584160:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380424.584166:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380424.584611:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787380424.584619:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380424.596762:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380424.596843:0:8292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915683072 00000100:00100000:3.0:1787380424.596853:0:8292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915683072 00000100:00100000:3.0:1787380424.596919:0:8292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:3.0:1787380424.596938:0:8292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:2356:x1874203915683072:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380424.596952:0:8292:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380424.596977:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f600/0x651a07d1188433be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ad7 expref: 29 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380424.596994:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:3.0:1787380424.596999:0:8292:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380424.597066:0:8292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:2356:x1874203915683072:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 129us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380424.597074:0:8292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:3.0:1787380424.600085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380424.600379:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915683328 00000100:00100000:2.0:1787380424.600389:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915683328 00000100:00100000:2.0:1787380424.600450:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 64 00000100:00100000:2.0:1787380424.600461:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+28:11605:x1874203915683328:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787380424.600696:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b521fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:11605:x1874203915683328:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 236us (620us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787380424.600704:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 64 00010000:00010000:1.0:1787380425.208597:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787380425.589157:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787380425.589188:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1787380425.589195:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1787380426.231577:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380426.432893:0:12463:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380426.432903:0:12463:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380426.432948:0:12463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787380426.432953:0:12463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380426.489155:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935588224:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380426.489257:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935588736:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489278:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380426.489302:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787380426.489306:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935588096:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380426.489373:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935588608:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380426.489409:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935588352:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380426.489466:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380426.489471:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935588480:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380426.489513:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588224 00000100:00100000:0.0:1787380426.489519:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588224 00000100:00100000:0.0:1787380426.489557:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588608 00000100:00100000:0.0:1787380426.489559:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588608 00000100:00100000:0.0:1787380426.489577:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588352 00000100:00100000:0.0:1787380426.489579:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588352 00000100:00100000:0.0:1787380426.489592:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787380426.489599:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935588224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489648:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935588224:12345-0@lo:400:kworker.0 Request processed in 49us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380426.489655:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787380426.489672:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787380426.489678:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935588608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489702:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935588608:12345-0@lo:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380426.489708:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787380426.489720:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787380426.489726:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935588352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489753:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935588352:12345-0@lo:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380426.489759:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787380426.489775:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588096 00000100:00100000:0.0:1787380426.489779:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588096 00000100:00100000:0.0:1787380426.489811:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787380426.489817:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935588096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489846:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935588096:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380426.489852:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787380426.489877:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588736 00000100:00100000:0.0:1787380426.489880:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588736 00000100:00100000:0.0:1787380426.489901:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588480 00000100:00100000:0.0:1787380426.489904:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588480 00000100:00100000:0.0:1787380426.489922:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787380426.489928:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935588736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489954:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935588736:12345-0@lo:400:kworker.0 Request processed in 26us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380426.489960:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787380426.489969:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787380426.489974:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935588480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.489995:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5197100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935588480:12345-0@lo:400:kworker.0 Request processed in 21us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380426.490000:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1787380426.490015:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380426.490018:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380426.490033:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380426.490063:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935588480:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.490071:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935588352:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.490094:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935588096:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.490101:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935588608:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.490116:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935588224:0@lo:400:kworker.0 00000100:00100000:0.0:1787380426.490123:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787380426.490127:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b5231880, transno 4294967307 00000004:00080000:0.0:1787380426.490137:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787380426.490151:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b5234000, transno 4294967310 00000100:00100000:0.0:1787380426.490155:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935588736:0@lo:400:kworker.0 00000100:00100000:3.0:1787380426.586249:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380426.586412:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915683584 00000100:00100000:1.0:1787380426.586423:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915683584 00000100:00100000:1.0:1787380426.586495:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 236 00000100:00100000:1.0:1787380426.586504:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+29:11626:x1874203915683584:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:1.0:1787380426.586528:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380426.586560:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188433d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ade expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380426.586660:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188433da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380426.586674:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188433da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380426.586685:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188433da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380426.586695:0:5787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787380426.586811:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fc00/0x651a07d1188433d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ade expref: 32 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380426.586829:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188433da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ade expref: 31 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380426.586838:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:1.0:1787380426.586841:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787380426.586844:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f200, rc 0) 00000100:00100000:1.0:1787380426.586895:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:11626:x1874203915683584:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 392us (655us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787380426.586902:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 236 00000100:00080000:3.0:1787380426.587428:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380426.598404:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380426.598448:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915683712 00000100:00100000:3.0:1787380426.598457:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915683712 00000100:00100000:3.0:1787380426.598518:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 237 00000100:00100000:3.0:1787380426.598528:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:11626:x1874203915683712:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:3.0:1787380426.598603:0:7761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598618:0:7761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598630:0:7761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598674:0:7761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598681:0:7761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598688:0:7761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598694:0:7761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380426.598698:0:7761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598706:0:7761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598720:0:7761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:3.0:1787380426.598723:0:7761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380426.598728:0:7761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380426.598733:0:7761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216de00/0x651a07d1188433e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380426.598800:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:11626:x1874203915683712:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 272us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380426.598809:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 237 00000100:00100000:3.0:1787380426.723307:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380426.723683:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915683840 00000100:00100000:0.0:1787380426.723692:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915683840 00000100:00100000:0.0:1787380426.723766:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00100000:0.0:1787380426.723776:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2353:x1874203915683840:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:0.0:1787380426.723793:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380426.723813:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d1188433ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ae5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380426.723838:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8942c6, atime: 0x6a8942c5, ctime: 0x6a8942c6, blocks: 0xb 00010000:00010000:0.0:1787380426.723858:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787380426.723863:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380426.723872:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d1188433ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ae5 expref: 8 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380426.723891:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d1188433ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ae5 expref: 8 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380426.723905:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380426.723967:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2353:x1874203915683840:12345-192.168.206.14@tcp:101:cat.0 Request processed in 192us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380426.723987:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 70 00000100:00080000:3.0:1787380426.724688:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380426.727418:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380426.733279:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915683968 00000100:00100000:2.0:1787380426.733296:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915683968 00002000:00100000:2.0:1787380426.733384:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9d9585f0c700 x1874203915683968/t0(0) o3->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:232/0 lens 488/0 e 0 to 0 dl 1787380437 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787380426.733398:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d9585f0c700 with x1874203915683968 ext(0->4095) 00002000:00010000:2.0:1787380426.733404:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d9585f0c700 00000100:00100000:2.0:1787380426.733435:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:2.0:1787380426.733444:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915683968:12345-192.168.206.14@tcp:3:cat.0 00000100:00100000:2.0:1787380426.733803:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2355:x1874203915683968:12345-192.168.206.14@tcp:3:cat.0 Request processed in 359us (6393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787380426.733812:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00002000:00100000:2.0:1787380426.733830:0:6584:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9d9585f0c700 x1874203915683968/t0(0) o3->7dca2b77-2f7d-460b-a508-1b61c3cf2401@192.168.206.14@tcp:232/0 lens 488/4536 e 0 to 0 dl 1787380437 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787380426.733841:0:6584:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d9585f0c700 with x1874203915683968 ext(0->4095) 00002000:00010000:2.0:1787380426.733846:0:6584:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d9585f0c700 00000100:00100000:2.0:1787380427.000532:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935588864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380427.000604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380427.000847:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588864 00000100:00100000:0.0:1787380427.000855:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588864 00000100:00100000:0.0:1787380427.000911:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787380427.000920:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935588864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380427.000953:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380427.001013:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935588864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380427.001030:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787380427.001136:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935588864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787380427.255485:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787380428.025396:0:6681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378337054634ns, next at 379337052400ns, rc = 0 00000100:00100000:0.0:1787380428.025425:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380428.025444:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935588992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380428.025664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380428.025723:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935588992 00000100:00100000:0.0:1787380428.025730:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935588992 00000100:00100000:0.0:1787380428.025782:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787380428.025790:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935588992:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787380428.025820:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787380428.025823:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380428.025864:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935588992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380428.025870:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787380428.025927:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935588992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380428.145838:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380428.145871:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380428.145905:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380428.145926:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915684480 00000100:00100000:2.0:1787380428.145934:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380428.145936:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915684480 00000100:00100000:2.0:1787380428.145963:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380428.145988:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915684096 00000100:00100000:2.0:1787380428.145992:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915684096 00000100:00100000:3.0:1787380428.146003:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915684352 00000100:00100000:3.0:1787380428.146008:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915684352 00000100:00100000:2.0:1787380428.146038:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 298 00000100:00100000:2.0:1787380428.146049:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915684096:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380428.146114:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2354:x1874203915684096:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380428.146122:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 298 00000100:00100000:3.0:1787380428.147833:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 96 00000100:00100000:3.0:1787380428.147853:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915684480:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380428.147917:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2354:x1874203915684480:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 73us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380428.147924:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 96 00000100:00100000:3.0:1787380428.147944:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 97 00000100:00100000:3.0:1787380428.147951:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2354:x1874203915684352:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380428.147975:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7dca2b77-2f7d-460b-a508-1b61c3cf2401+8:2354:x1874203915684352:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 25us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380428.147981:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 97 00000100:00100000:1.0:1787380428.148119:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915684224 00000100:00100000:1.0:1787380428.148127:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915684224 00000100:00100000:1.0:1787380428.148173:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915684608 00000100:00100000:1.0:1787380428.148189:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915684608 00000100:00100000:1.0:1787380428.148215:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 161 00000100:00100000:1.0:1787380428.148223:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:2354:x1874203915684224:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380428.148259:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+31:2354:x1874203915684224:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 38us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380428.148266:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 161 00000100:00100000:1.0:1787380428.148281:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 162 00000100:00100000:1.0:1787380428.148288:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915684608:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380428.148312:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+5:2354:x1874203915684608:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 25us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380428.148318:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 162 00000100:00080000:3.0:1787380428.149790:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380428.149801:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380428.149805:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787380428.279581:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787380428.616326:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:0.0:1787380428.616951:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000004:00080000:0.0:1787380428.631318:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:0.0:1787380428.631389:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1787380428.631407:0:5808:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d96bd457600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787380428.631412:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9695937200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d96bd457a80 00000020:00080000:0.0:1787380428.631415:0:5808:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d9695937b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d95858c9000 00000001:00080000:0.0:1787380428.631436:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787380428.631441:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000100:00100000:3.0:1787380428.631831:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935589120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787380428.631895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787380428.632194:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787380428.632565:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1787380428.632644:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935589120 00000100:00100000:0.0:1787380428.632652:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935589120 00000100:00100000:0.0:1787380428.632698:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787380428.632707:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935589120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787380428.632956:0:6578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787380428.632960:0:6578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787380422 -> 1787380422 00002000:00010000:0.0:1787380428.632962:0:6578:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1787380421 -> 1787380421 00002000:00010000:0.0:1787380428.632964:0:6578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787380422 -> 1787380422 00002000:00010000:0.0:1787380428.632966:0:6578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787380428.633032:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585f0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935589120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 326us (1135us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787380428.633039:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787380428.633933:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1787380428.633940:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d9688e7bb80, transno 4294967321 00000004:00080000:1.0:1787380428.633957:0:3299:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1787380428.633979:0:3299:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d96b5114380 x1874203935589120/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787380444 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787380428.633990:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d96b5114380/2, rc 0, transno 4294967324 00000100:00100000:1.0:1787380428.633996:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935589120:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787380429.304938:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380430.327626:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380430.715527:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380430.715536:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380430.715578:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787380430.715584:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380431.027628:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380431.028041:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915684736 00000100:00100000:1.0:1787380431.028051:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915684736 00000100:00100000:1.0:1787380431.028133:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 238 00000100:00100000:1.0:1787380431.028153:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11278:x1874203915684736:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787380431.028301:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11278:x1874203915684736:12345-192.168.206.14@tcp:60:lhsmtool_posix.0 Request processed in 151us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380431.028327:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 238 00000100:00080000:3.0:1787380431.029377:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380431.035090:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380431.035192:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915684992 00000100:00100000:3.0:1787380431.035202:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915684992 00000100:00100000:3.0:1787380431.035262:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 65 00000100:00100000:3.0:1787380431.035272:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:11278:x1874203915684992:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787380431.035885:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:11278:x1874203915684992:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 611us (801us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787380431.035896:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 65 00010000:00010000:1.0:1787380431.351800:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380431.383603:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380431.383711:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915685120 00000100:00100000:1.0:1787380431.383722:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915685120 00000100:00080000:3.0:1787380431.383789:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380431.383803:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 239 00000100:00100000:1.0:1787380431.383815:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+5:12080:x1874203915685120:12345-192.168.206.14@tcp:101:lsof.0 00010000:00010000:1.0:1787380431.383835:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380431.383866:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188433f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6aec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380431.383930:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d1188433fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380431.383943:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d1188433fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380431.383955:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d1188433fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380431.384169:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787380431.384174:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380431.384253:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d1188433fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380431.384277:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188433f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aec expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380431.384294:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d1188433fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aec expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380431.384314:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:1.0:1787380431.384317:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380431.384320:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515ea00, rc 0) 00000100:00100000:1.0:1787380431.384724:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95d22c36-51bc-485d-88b7-d90632ec1801+6:12080:x1874203915685120:12345-192.168.206.14@tcp:101:lsof.0 Request processed in 911us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380431.384732:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 239 00000100:00100000:1.0:1787380431.607737:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935589504:0@lo:400:kworker.0 00000100:00100000:1.0:1787380431.607808:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380431.607871:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787380431.607878:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935589376:0@lo:400:kworker.0 00000100:00100000:1.0:1787380431.607901:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380431.607918:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935589888:0@lo:400:kworker.0 00000100:00100000:1.0:1787380431.607941:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380431.607977:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935589504 00000100:00100000:1.0:1787380431.607984:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935589504 00000100:00100000:2.0:1787380431.608110:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935589376 00000100:00100000:2.0:1787380431.608115:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935589376 00000100:00100000:2.0:1787380431.608158:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787380431.608167:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935589376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380431.608244:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935589376:12345-0@lo:400:kworker.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380431.608252:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787380431.608407:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935589632:0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380431.608486:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787380431.608493:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935589248:0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380431.608543:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935589760:0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380431.608589:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935589888 00000100:00100000:3.0:1787380431.608593:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935589888 00000100:00100000:3.0:1787380431.608627:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935589632 00000100:00100000:3.0:1787380431.608630:0:8465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935589632 00000100:00100000:3.0:1787380431.608651:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787380431.608658:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935589888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608691:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935589888:12345-0@lo:400:kworker.0 Request processed in 34us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380431.608697:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787380431.608710:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787380431.608715:0:8465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935589632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608759:0:8465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1874203935589632:12345-0@lo:400:kworker.0 Request processed in 43us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380431.608765:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1787380431.608782:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380431.608786:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380431.608811:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935589632:0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608852:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935589376:0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608861:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935589888:0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608886:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935589760 00000100:00100000:3.0:1787380431.608890:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935589760 00000100:00100000:3.0:1787380431.608914:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787380431.608920:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bceeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935589760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380431.608952:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bceeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935589760:12345-0@lo:400:kworker.0 Request processed in 32us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380431.608957:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1787380431.608969:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380431.608984:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935589760:0@lo:400:kworker.0 00000100:00100000:1.0:1787380431.609361:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787380431.609370:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935589504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380431.609407:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935589504:12345-0@lo:400:kworker.0 Request processed in 39us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380431.609412:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787380431.609592:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935589248 00000100:00100000:0.0:1787380431.609597:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935589248 00000100:00100000:0.0:1787380431.609628:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1787380431.609635:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935589248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380431.609685:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d968b5e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935589248:12345-0@lo:400:kworker.0 Request processed in 50us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380431.609691:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787380431.609946:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935589248:0@lo:400:kworker.0 00000100:00080000:3.0:1787380431.610084:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380431.610109:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935589504:0@lo:400:kworker.0 00000100:00100000:2.0:1787380432.120095:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380432.120118:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935590016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380432.120187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380432.120422:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590016 00000100:00100000:1.0:1787380432.120429:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590016 00000100:00100000:1.0:1787380432.120484:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380432.120505:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935590016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380432.120539:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380432.120590:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935590016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380432.120596:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787380432.120679:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935590016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380432.375882:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380433.144487:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380433.144509:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935590144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380433.144583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380433.144825:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590144 00000100:00100000:2.0:1787380433.144834:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590144 00000100:00100000:2.0:1787380433.144896:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787380433.144906:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874203935590144:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787380433.144919:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787380433.144939:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380433.145008:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874203935590144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380433.145016:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787380433.145049:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935590144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380433.268694:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380433.268738:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380433.268777:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380433.268812:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380433.268834:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380433.268865:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915685504 00000100:00100000:3.0:1787380433.268873:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915685504 00000100:00100000:3.0:1787380433.268921:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915685632 00000100:00100000:3.0:1787380433.268925:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915685632 00000100:00100000:3.0:1787380433.268944:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 100 00000100:00100000:3.0:1787380433.268953:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915685504:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380433.269030:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915685504:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380433.269038:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 100 00000100:00100000:3.0:1787380433.269053:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 101 00000100:00100000:3.0:1787380433.269060:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915685632:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380433.269085:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915685632:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380433.269091:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 101 00000100:00080000:3.0:1787380433.269107:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380433.269111:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380433.269319:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915685248 00000100:00100000:0.0:1787380433.269324:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915685248 00000100:00100000:0.0:1787380433.269396:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 300 00000100:00100000:0.0:1787380433.269404:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915685248:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380433.269432:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687197050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915685248:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 29us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380433.269438:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 300 00000100:00100000:1.0:1787380433.270543:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915685760 00000100:00100000:1.0:1787380433.270553:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915685760 00000100:00100000:1.0:1787380433.270617:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915685376 00000100:00100000:1.0:1787380433.270621:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915685376 00000100:00100000:1.0:1787380433.270647:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:1.0:1787380433.270655:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:2356:x1874203915685760:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380433.270715:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:2356:x1874203915685760:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 60us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380433.270722:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 166 00000100:00100000:1.0:1787380433.270738:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00100000:1.0:1787380433.270745:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:2356:x1874203915685376:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380433.270793:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:2356:x1874203915685376:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 49us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380433.270800:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 167 00000100:00080000:3.0:1787380433.272541:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787380433.399671:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787380433.732562:0:5808:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1787380433.732586:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1787380433.736139:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787380433.736161:0:5819:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787380433.744485:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1787380434.425408:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380434.982881:0:12669:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:33:53 (1787380433) 00010000:00010000:1.0:1787380435.447560:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380436.479751:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380436.727926:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935590272:0@lo:400:kworker.0 00000100:00100000:3.0:1787380436.727961:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935590528:0@lo:400:kworker.0 00000100:00100000:2.0:1787380436.728069:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935590400:0@lo:400:kworker.0 00000100:00100000:1.0:1787380436.728117:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935590656:0@lo:400:kworker.0 00000100:00100000:3.0:1787380436.733754:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380436.733897:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590528 00000100:00100000:3.0:1787380436.733910:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590528 00000100:00100000:3.0:1787380436.734006:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787380436.734024:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935590528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380436.734107:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935590528:12345-0@lo:400:kworker.0 Request processed in 89us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380436.734132:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1787380436.734157:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380436.734213:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935590528:0@lo:400:kworker.0 00000100:00100000:0.0:1787380436.734740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380436.734800:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b56a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935590784:0@lo:400:kworker.0 00000100:00100000:0.0:1787380436.734854:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380436.734892:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590272 00000100:00100000:0.0:1787380436.734898:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590272 00000100:00100000:0.0:1787380436.734931:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787380436.734939:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935590272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380436.734998:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935590272:12345-0@lo:400:kworker.0 Request processed in 59us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380436.735005:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787380436.735048:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590784 00000100:00100000:0.0:1787380436.735062:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590784 00000100:00100000:2.0:1787380436.735099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380436.735161:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bcaf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935590912:0@lo:400:kworker.0 00000100:00100000:2.0:1787380436.735203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380436.735898:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590400 00000100:00100000:0.0:1787380436.735906:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590400 00000100:00100000:2.0:1787380436.739932:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787380436.740142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787380436.740275:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380436.743243:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787380436.743451:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935590784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380436.743594:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935590784:12345-0@lo:400:kworker.0 Request processed in 3645us (8738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380436.743621:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787380436.743869:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935590784:0@lo:400:kworker.0 00000100:00100000:1.0:1787380436.743886:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935590272:0@lo:400:kworker.0 00000100:00100000:1.0:1787380436.743996:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590912 00000100:00100000:1.0:1787380436.744005:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590912 00000100:00100000:1.0:1787380436.744070:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935590656 00000100:00100000:1.0:1787380436.744074:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935590656 00000100:00100000:1.0:1787380436.744096:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787380436.744104:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935590912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380436.744157:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935590912:12345-0@lo:400:kworker.0 Request processed in 53us (8953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380436.744164:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787380436.744186:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787380436.744193:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935590656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380436.744233:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935590656:12345-0@lo:400:kworker.0 Request processed in 40us (4092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380436.744241:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1787380436.744243:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380436.744249:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380436.744565:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bcaf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935590912:0@lo:400:kworker.0 00000100:00100000:1.0:1787380436.744607:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787380436.744615:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d96b5114380, transno 4294967324 00000100:00100000:1.0:1787380436.744627:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b56a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935590656:0@lo:400:kworker.0 00000100:00100000:3.0:1787380436.750686:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935590400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380436.750835:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935590400:12345-0@lo:400:kworker.0 Request processed in 7575us (15736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380436.750847:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787380436.752460:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935590400:0@lo:400:kworker.0 00000100:00100000:2.0:1787380437.243556:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380437.243589:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935591040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380437.243681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380437.243924:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591040 00000100:00100000:2.0:1787380437.243936:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591040 00000100:00100000:2.0:1787380437.244006:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787380437.244017:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935591040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380437.244063:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380437.244121:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935591040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380437.244130:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787380437.244192:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935591040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787380437.495855:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380438.267186:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380438.267216:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935591168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380438.267307:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380438.267544:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591168 00000100:00100000:2.0:1787380438.267556:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591168 00000100:00100000:2.0:1787380438.267638:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787380438.267650:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935591168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380438.267695:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380438.267748:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935591168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380438.267756:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787380438.267832:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380438.268409:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935591168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380438.390469:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380438.390528:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380438.390574:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380438.390615:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380438.390767:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915686016 00000100:00100000:1.0:1787380438.390779:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915686016 00000100:00100000:2.0:1787380438.390827:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915685888 00000100:00100000:2.0:1787380438.390838:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915685888 00000100:00100000:1.0:1787380438.390869:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 171 00000100:00100000:2.0:1787380438.390882:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 302 00000100:00100000:2.0:1787380438.390896:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915685888:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380438.390900:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:2356:x1874203915686016:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380438.391016:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:2356:x1874203915686016:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 120us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380438.391025:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 171 00000100:00100000:1.0:1787380438.391054:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915686272 00000100:00100000:1.0:1787380438.391057:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915686272 00000100:00100000:1.0:1787380438.391082:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915686144 00000100:00100000:1.0:1787380438.391084:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915686144 00000100:00100000:1.0:1787380438.391104:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:1.0:1787380438.391110:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bcaf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915686272:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380438.391136:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bcaf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2356:x1874203915686272:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 26us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380438.391143:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:1.0:1787380438.391153:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 105 00000100:00100000:1.0:1787380438.391159:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915686144:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:1.0:1787380438.391181:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2356:x1874203915686144:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 22us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380438.391187:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 105 00000100:00100000:2.0:1787380438.391385:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915685888:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 446us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380438.391394:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 302 00000100:00080000:3.0:1787380438.393314:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380438.393325:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380438.393329:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380438.397256:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380438.399102:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915686400 00000100:00100000:2.0:1787380438.399119:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915686400 00000100:00100000:2.0:1787380438.399304:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 172 00000100:00100000:2.0:1787380438.399315:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:2356:x1874203915686400:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380438.399853:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95d22c36-51bc-485d-88b7-d90632ec1801+6:2356:x1874203915686400:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 538us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380438.399863:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 172 00000100:00080000:3.0:1787380438.399938:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787380438.521327:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380439.336086:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380439.336191:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915686656 00000100:00100000:0.0:1787380439.336205:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915686656 00000100:00100000:0.0:1787380439.336281:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:0.0:1787380439.336293:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+18:12301:x1874203915686656:12345-192.168.206.14@tcp:35:umount.0 00000100:00100000:0.0:1787380439.338299:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:12301:x1874203915686656:12345-192.168.206.14@tcp:35:umount.0 Request processed in 1993us (2216us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787380439.338317:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 66 00000100:00100000:0.0:1787380439.353461:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380439.353724:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915686912 00000100:00100000:2.0:1787380439.353740:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915686912 00000100:00100000:2.0:1787380439.353815:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:2.0:1787380439.353827:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+19:12301:x1874203915686912:12345-192.168.206.14@tcp:35:umount.0 00000100:00100000:2.0:1787380439.354708:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:12301:x1874203915686912:12345-192.168.206.14@tcp:35:umount.0 Request processed in 878us (1257us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787380439.354720:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 67 00000100:00100000:3.0:1787380439.362045:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380439.362687:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915687168 00000100:00100000:2.0:1787380439.362702:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915687168 00000100:00100000:2.0:1787380439.362777:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:2.0:1787380439.362788:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d969f13a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+20:12301:x1874203915687168:12345-192.168.206.14@tcp:35:umount.0 00000100:00100000:2.0:1787380439.363846:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d969f13a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:12301:x1874203915687168:12345-192.168.206.14@tcp:35:umount.0 Request processed in 1052us (1810us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787380439.363858:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 68 00000100:00100000:1.0:1787380439.368070:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380439.368629:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915687424 00000100:00100000:2.0:1787380439.368661:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915687424 00000100:00100000:2.0:1787380439.368734:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:2.0:1787380439.368746:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:12301:x1874203915687424:12345-192.168.206.14@tcp:35:umount.0 00000100:00100000:2.0:1787380439.369900:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:12301:x1874203915687424:12345-192.168.206.14@tcp:35:umount.0 Request processed in 1148us (1838us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787380439.369912:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 69 00000100:00100000:0.0:1787380439.376914:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380439.377036:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380439.377456:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915687552 00000100:00100000:3.0:1787380439.377470:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915687552 00000100:00100000:3.0:1787380439.377548:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915687680 00000100:00100000:3.0:1787380439.377552:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915687680 00000100:00100000:3.0:1787380439.377833:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1787380439.377845:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+14:2356:x1874203915687552:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380439.377864:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380439.377888:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2000/0x651a07d118842475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6677 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380439.377923:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380439.378007:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+13:2356:x1874203915687552:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 163us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380439.378016:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1787380439.378036:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:3.0:1787380439.378043:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:2356:x1874203915687680:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380439.378051:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380439.378060:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96813f2800/0x651a07d1188423db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f663f expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380439.378070:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380439.378090:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2356:x1874203915687680:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 47us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380439.378096:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:1.0:1787380439.381759:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380439.381857:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380439.381984:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915687808 00000100:00100000:2.0:1787380439.381999:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915687808 00000100:00100000:2.0:1787380439.382121:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 72 00000100:00100000:2.0:1787380439.382135:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+5:2352:x1874203915687808:12345-192.168.206.14@tcp:9:umount.0 00000100:00100000:3.0:1787380439.382139:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915687936 00000100:00100000:3.0:1787380439.382163:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915687936 00000020:00000080:2.0:1787380439.382178:0:6577:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d11884274d 00000100:00080000:2.0:1787380439.382193:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9d96b5e4f000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787380439.382252:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000001:00000004:2.0:1787380439.382256:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787380439.382267:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2355:x1874203915687936:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380439.382288:0:5772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380439.382310:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163ba00/0x651a07d11884265f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6742 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380439.382334:0:5772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380439.382444:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2355:x1874203915687936:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 181us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380439.382469:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:2.0:1787380439.382882:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7dca2b77-2f7d-460b-a508-1b61c3cf2401+2:2352:x1874203915687808:12345-192.168.206.14@tcp:9:umount.0 Request processed in 747us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380439.382892:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 72 00010000:00010000:0.0:1787380439.383030:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380439.388796:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380439.389165:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915688320 00000100:00100000:2.0:1787380439.389180:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915688320 00000100:00100000:2.0:1787380439.389259:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 73 00000100:00100000:2.0:1787380439.389276:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+7:2352:x1874203915688320:12345-192.168.206.14@tcp:9:umount.0 00000020:00000080:2.0:1787380439.389321:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188429b5 00000020:00010000:2.0:1787380439.389331:0:6578:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d9687394000: total 0 00000100:00080000:2.0:1787380439.389356:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9d9687397800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380439.389475:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1787380439.389584:0:5774:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d9687394000: total 0 00010000:00010000:3.0:1787380439.389797:0:5774:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d9687394000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787380439.389875:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118842d51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6917 expref: 5 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380439.389917:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+4:2352:x1874203915688320:12345-192.168.206.14@tcp:9:umount.0 Request processed in 645us (1132us total) trans 0 rc 0/0 00010000:00010000:3.0:1787380439.389922:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2aefe0b/0x651a07d1188433ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ae5 expref: 4 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380439.389941:0:5774:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d9687394000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787380439.389965:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380439.389968:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380439.389971:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380439.390071:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 73 00000100:00100000:3.0:1787380439.408929:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380439.410713:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915689344 00000100:00100000:1.0:1787380439.410734:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915689344 00000100:00100000:1.0:1787380439.410903:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 240 00000100:00100000:1.0:1787380439.410932:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+22:2352:x1874203915689344:12345-192.168.206.14@tcp:39:umount.0 00000020:00000080:1.0:1787380439.410990:0:5788:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188423e9 00000020:00010000:1.0:1787380439.411015:0:5788:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d96bfd8b000: total 0 00000100:00080000:1.0:1787380439.411020:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9d96bfd8b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380439.411063:0:5788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787380439.411556:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7dca2b77-2f7d-460b-a508-1b61c3cf2401+21:2352:x1874203915689344:12345-192.168.206.14@tcp:39:umount.0 Request processed in 623us (2633us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787380439.411566:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 240 00000020:00010000:2.0:1787380439.411640:0:5775:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d96bfd8b000: total 0 00010000:00010000:2.0:1787380439.411656:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380439.411703:0:5775:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d96bfd8b000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787380439.411746:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380439.411750:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787380439.411759:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f200/0x651a07d1188433da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ade expref: 20 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.411780:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380439.411783:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787380439.411787:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118842a10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f683e expref: 19 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.411799:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d968727fe00) 00010000:00010000:2.0:1787380439.411801:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380439.411805:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163aa00/0x651a07d1188426b3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6750 expref: 18 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.411834:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380439.411837:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787380439.411842:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f000/0x651a07d118842d3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6910 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.411859:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380439.411862:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787380439.411868:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f800/0x651a07d1188430ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a0c expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.411904:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d96991e8300) 00010000:00010000:2.0:1787380439.411907:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787380439.411912:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118842723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f676c expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.411934:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380439.411937:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380439.411940:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d1188432d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6a98 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.411968:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d968911d800) 00010000:00010000:2.0:1787380439.411971:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787380439.411976:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e800/0x651a07d118842dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f693a expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.412000:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380439.412004:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380439.412008:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d118842c32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f68ca expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.412021:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d968727fb00) 00010000:00010000:2.0:1787380439.412023:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380439.412027:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188426cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6757 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.412041:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d968727f800) 00010000:00010000:2.0:1787380439.412043:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380439.412054:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118842d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6902 expref: 10 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.412074:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d968911df00) 00010000:00010000:2.0:1787380439.412077:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380439.412080:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216d800/0x651a07d1188433b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ad0 expref: 9 pid: 7761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.412097:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:2.0:1787380439.412099:0:5775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380439.412102:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96c216c000/0x651a07d118842db3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6933 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380439.412113:0:5775:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d96bfd8b000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787380439.412125:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380439.412127:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380439.412129:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380439.546664:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380440.568442:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787380440.886677:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:1.0:1787380440.886687:0:7479:0:(genops.c:906:class_export_put()) final put ffff9d96b5e4d000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:2.0:1787380440.886773:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96b5e4d000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 for lustre-OST0001 00000020:00000080:2.0:1787380440.886821:0:12642:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96b5e4f000 for lustre-OST0001 00000040:00080000:2.0:1787380440.951631:0:11526:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380440.951641:0:11526:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380440.952487:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787380440.952497:0:11526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380441.201007:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380441.201061:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380441.201094:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380441.201183:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915689472 00000100:00100000:2.0:1787380441.201193:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915689472 00000100:00100000:2.0:1787380441.201251:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915689728 00000100:00100000:2.0:1787380441.201254:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915689728 00000100:00100000:2.0:1787380441.201271:0:11008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915689600 00000100:00100000:2.0:1787380441.201274:0:11008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915689600 00000100:00100000:2.0:1787380441.201309:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:2.0:1787380441.201318:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a711699-f0d0-43cb-9af5-66a5d2b04101+12:2354:x1874203915689472:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380441.201334:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380441.201388:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af54000/0x651a07d1188424bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f668c expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380441.201406:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380441.201463:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a711699-f0d0-43cb-9af5-66a5d2b04101+11:2354:x1874203915689472:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 146us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380441.201472:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:2.0:1787380441.201489:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:2.0:1787380441.201495:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a711699-f0d0-43cb-9af5-66a5d2b04101+10:2354:x1874203915689728:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380441.201503:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380441.201511:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1fa00/0x651a07d118842658 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f673b expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380441.201520:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380441.201538:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a711699-f0d0-43cb-9af5-66a5d2b04101+9:2354:x1874203915689728:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 44us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380441.201545:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:2.0:1787380441.201590:0:11008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:2.0:1787380441.201596:0:11008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a711699-f0d0-43cb-9af5-66a5d2b04101+8:2354:x1874203915689600:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380441.201603:0:11008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380441.201612:0:11008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af55000/0x651a07d1188424c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f66b6 expref: 8 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380441.201630:0:11008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380441.201648:0:11008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5159500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8a711699-f0d0-43cb-9af5-66a5d2b04101+7:2354:x1874203915689600:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 52us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380441.201655:0:11008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:3.0:1787380441.210844:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380441.210988:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915689984 00000100:00100000:1.0:1787380441.211000:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915689984 00000100:00100000:1.0:1787380441.211086:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 241 00000100:00100000:1.0:1787380441.211096:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+6:2352:x1874203915689984:12345-192.168.206.14@tcp:39:umount.0 00000020:00000080:1.0:1787380441.211140:0:5786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188424d0 00000020:00010000:1.0:1787380441.211157:0:5786:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d9688ff2000: total 0 00000100:00080000:1.0:1787380441.211162:0:5786:0:(import.c:65:import_set_state_nolock()) ffff9d9688ff1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380441.211194:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1787380441.211490:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95d22c36-51bc-485d-88b7-d90632ec1801+5:2352:x1874203915689984:12345-192.168.206.14@tcp:39:umount.0 Request processed in 395us (652us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1787380441.211499:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 241 00000020:00010000:0.0:1787380441.211706:0:5774:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d9688ff2000: total 0 00010000:00010000:0.0:1787380441.211769:0:5774:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d9688ff2000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787380441.211804:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d968727fd00) 00010000:00010000:0.0:1787380441.211808:0:5774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380441.211816:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ea00/0x651a07d1188433fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6aec expref: 4 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380441.211856:0:5774:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d9688ff2000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787380441.211867:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380441.211869:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380441.211871:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787380441.218833:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380441.246970:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380441.247074:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915690240 00000100:00100000:1.0:1787380441.247086:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915690240 00000100:00100000:1.0:1787380441.247161:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 303 00000100:00100000:1.0:1787380441.247172:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+7:2352:x1874203915690240:12345-192.168.206.14@tcp:251:umount.0 00000020:00000080:1.0:1787380441.247240:0:5781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188423c6 00000020:00010000:1.0:1787380441.247264:0:5781:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d95851fb000: total 0 00000100:00080000:1.0:1787380441.247269:0:5781:0:(import.c:65:import_set_state_nolock()) ffff9d95851fc800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787380441.247396:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687195850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a711699-f0d0-43cb-9af5-66a5d2b04101+3:2352:x1874203915690240:12345-192.168.206.14@tcp:251:umount.0 Request processed in 225us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380441.247405:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 303 00000020:00010000:0.0:1787380441.247730:0:5775:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d95851fb000: total 0 00010000:00010000:0.0:1787380441.247735:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380441.247784:0:5775:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d95851fb000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787380441.247818:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af54400/0x651a07d11884247c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f667e expref: 2 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380441.247833:0:5775:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d95851fb000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787380441.247842:0:5775:0:(genops.c:906:class_export_put()) final put ffff9d95851fb000/8a711699-f0d0-43cb-9af5-66a5d2b04101 00010000:00010000:0.0:1787380441.247861:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380441.247863:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380441.247865:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787380441.249188:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d95851fb000/8a711699-f0d0-43cb-9af5-66a5d2b04101 for MGS 00000020:00000080:1.0:1787380441.249243:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d95851fc800 for MGS 00010000:00010000:0.0:1787380441.593968:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380441.847733:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935591424:0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.847802:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380441.847849:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935591936:0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.847894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380441.847929:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380441.847947:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935591552:0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.847971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380441.848011:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591424 00000100:00100000:3.0:1787380441.848018:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591424 00000100:00100000:3.0:1787380441.848066:0:7761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591552 00000100:00100000:3.0:1787380441.848070:0:7761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591552 00000100:00100000:3.0:1787380441.848098:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787380441.848105:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935591424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.848156:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935591424:12345-0@lo:400:kworker.0 Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380441.848163:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787380441.848178:0:7761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787380441.848185:0:7761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935591552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.848213:0:7761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935591552:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380441.848219:0:7761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1787380441.848233:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380441.848264:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935591552:0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.848274:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935591424:0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848360:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935591296:0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380441.848430:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96911bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935591808:0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380441.848484:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380441.848490:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935591680:0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380441.848540:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591936 00000100:00100000:0.0:1787380441.848544:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591936 00000100:00100000:0.0:1787380441.848572:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591680 00000100:00100000:0.0:1787380441.848575:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591680 00000100:00100000:0.0:1787380441.848605:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787380441.848611:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935591936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848646:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935591936:12345-0@lo:400:kworker.0 Request processed in 35us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380441.848652:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787380441.848665:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787380441.848671:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935591680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848702:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935591680:12345-0@lo:400:kworker.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380441.848708:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787380441.848738:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935591680:0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848773:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591808 00000100:00100000:0.0:1787380441.848776:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591808 00000100:00100000:0.0:1787380441.848800:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787380441.848807:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935591808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380441.848842:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874203935591808:12345-0@lo:400:kworker.0 Request processed in 35us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380441.848848:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787380441.848879:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935591808:0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.849205:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935591296 00000100:00100000:3.0:1787380441.849210:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935591296 00000100:00100000:3.0:1787380441.849245:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787380441.849252:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935591296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.849289:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9687196c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3300:x1874203935591296:12345-0@lo:400:kworker.0 Request processed in 38us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380441.849296:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1787380441.849320:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380441.849325:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380441.849327:0:5782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380441.849366:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96911be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935591936:0@lo:400:kworker.0 00000100:00100000:3.0:1787380441.849401:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935591296:0@lo:400:kworker.0 00000100:00100000:1.0:1787380442.360952:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380442.360978:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935592064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380442.361048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380442.361108:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592064 00000100:00100000:1.0:1787380442.361115:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592064 00000100:00100000:1.0:1787380442.361169:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380442.361179:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935592064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380442.361215:0:6581:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380442.361269:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935592064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380442.361276:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787380442.362137:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935592064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787380442.615675:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787380442.948533:0:12868:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787380442.970467:0:12868:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787380442.970515:0:12868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.970531:0:12868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.970550:0:12868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.970557:0:12868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.970577:0:12868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787380442.970582:0:12868:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787380442.970622:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787380442.970626:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787380442.970632:0:12868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787380442.970664:0:12868:0:(import.c:65:import_set_state_nolock()) ffff9d96880bb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787380442.970716:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935592192:0@lo:39:umount.0 00000100:00100000:0.0:1787380442.970788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380442.970855:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592192 00000100:00100000:0.0:1787380442.970861:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592192 00000100:00100000:0.0:1787380442.970905:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787380442.970914:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874203935592192:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787380442.970949:0:5788:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188421d5 00000100:00080000:0.0:1787380442.970957:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9d96bd47b800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787380442.971011:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3298:x1874203935592192:12345-0@lo:39:umount.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380442.971018:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787380442.971027:0:5788:0:(genops.c:906:class_export_put()) final put ffff9d96bd47e800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787380442.971054:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380442.971059:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.971078:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e200 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380442.971083:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.971092:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380442.971099:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380442.971105:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380442.971108:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787380442.971110:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787380442.971149:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.971156:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380442.971173:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.971180:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e200/0x651a07d11884244b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842452 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.971191:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.971193:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.971195:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380442.971205:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935592320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380442.971234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787380442.971289:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96880bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787380442.971305:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935592192:0@lo:39:umount.0 00000100:00080000:0.0:1787380442.971326:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787380442.971329:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787380442.971332:0:12868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787380442.972204:0:12868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972219:0:12868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972225:0:12868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972231:0:12868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972250:0:12868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380442.972262:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380442.972266:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972273:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380442.972277:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972284:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380442.972291:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380442.972306:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380442.972308:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787380442.972331:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972363:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380442.972375:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972382:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2400/0x651a07d118842459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842460 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972393:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972395:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972397:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380442.972406:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380442.972416:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935592448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380442.972457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380442.972494:0:12868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972502:0:12868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972507:0:12868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972513:0:12868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972532:0:12868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380442.972539:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380442.972543:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972549:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380442.972552:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972559:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380442.972565:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380442.972570:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380442.972572:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787380442.972574:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787380442.972589:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972594:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380442.972609:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972616:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216d600/0x651a07d118842380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842387 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972628:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972635:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972637:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972647:0:12868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972655:0:12868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972660:0:12868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972666:0:12868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972676:0:12868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380442.972682:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380442.972686:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972691:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380442.972694:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972701:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380442.972707:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380442.972711:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787380442.972714:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787380442.972721:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787380442.972735:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972741:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380442.972747:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972753:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118842682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842689 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972763:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972765:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972766:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972775:0:12868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972782:0:12868:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972788:0:12868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972793:0:12868:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972804:0:12868:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787380442.972807:0:12868:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787380442.972809:0:12868:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787380442.972831:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380442.972834:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972849:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f2400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380442.972852:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972858:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380442.972863:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380442.972868:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380442.972870:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787380442.972872:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787380442.972885:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972890:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380442.972899:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972905:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f2400/0x651a07d118842134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d11884213b expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380442.972917:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972919:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380442.972920:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380442.972945:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935592832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380442.972970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787380442.973001:0:12868:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787380442.973009:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787380442.973013:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380442.973018:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/11 00000020:00080000:0.0:1787380442.973023:0:12868:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d96bd216000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787380442.973029:0:12868:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d96aaf15000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787380442.973036:0:12868:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d9688ff2000 95d22c36-51bc-485d-88b7-d90632ec1801 192.168.206.14@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787380442.973041:0:12868:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d96bfd8b000 7dca2b77-2f7d-460b-a508-1b61c3cf2401 192.168.206.14@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:0.0:1787380442.973046:0:12868:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9d96bd4219c0) has exports, disconnecting them 00000020:00080000:0.0:1787380442.973050:0:12868:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d96bd216000), last request at 1787380441 00000020:00000080:0.0:1787380442.973057:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842348 00000100:00080000:0.0:1787380442.973073:0:12868:0:(import.c:65:import_set_state_nolock()) ffff9d96bd217800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787380442.973566:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592320 00000100:00100000:1.0:1787380442.973574:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592320 00000100:00100000:1.0:1787380442.973620:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592448 00000100:00100000:1.0:1787380442.973624:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592448 00000100:00100000:1.0:1787380442.973651:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592832 00000100:00100000:1.0:1787380442.973655:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592832 00000100:00100000:1.0:1787380442.973672:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787380442.973680:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+21:3299:x1874203935592320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380442.973692:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380442.973706:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af55800/0x651a07d118842452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d11884244b expref: 21 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380442.973728:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380442.973769:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+20:3299:x1874203935592320:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380442.973777:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787380442.973795:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380442.973801:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+19:3299:x1874203935592448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380442.973808:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380442.973816:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af55e00/0x651a07d118842460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842459 expref: 19 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380442.973825:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380442.973845:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+18:3299:x1874203935592448:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380442.973851:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380442.973862:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380442.973868:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:3299:x1874203935592832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380442.973876:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380442.973884:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b000/0x651a07d11884213b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842134 expref: 17 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380442.973896:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380442.973918:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3299:x1874203935592832:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380442.973924:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380442.973981:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935592832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380442.973991:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935592448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380442.974009:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aaaa441-7de5-4747-b366-e84ba9a288bb:3299:1874203935592320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380442.974473:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935592576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380442.974510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380442.974535:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380442.974541:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935592704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380442.974561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380442.974585:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592576 00000100:00100000:2.0:1787380442.974589:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592576 00000100:00100000:2.0:1787380442.974632:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592704 00000100:00100000:2.0:1787380442.974635:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592704 00000100:00100000:2.0:1787380442.974656:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380442.974662:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+17:3301:x1874203935592576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380442.974670:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380442.974681:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163be00/0x651a07d118842387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842380 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380442.974694:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380442.974723:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+16:3301:x1874203935592576:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380442.974729:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380442.974742:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380442.974756:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+15:3301:x1874203935592704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380442.974765:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380442.974774:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96b515f600/0x651a07d118842689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842682 expref: 15 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380442.974783:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380442.974806:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aaaa441-7de5-4747-b366-e84ba9a288bb+14:3301:x1874203935592704:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380442.974812:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380442.974843:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935592704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380442.974851:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aaaa441-7de5-4747-b366-e84ba9a288bb:3301:1874203935592576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380442.975255:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787380442.975267:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd47e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787380442.975320:0:12642:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96bd47b800 for lustre-MDT0000 00000020:00080000:0.0:1787380442.982241:0:12868:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d96bd216000): rc 0 00000020:00000080:0.0:1787380442.982248:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96bd216000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787380442.982362:0:12868:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d96aaf15000), last request at 1787380441 00000020:00000080:0.0:1787380442.982370:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d11884227d 00000100:00080000:0.0:1787380442.982383:0:12868:0:(import.c:65:import_set_state_nolock()) ffff9d96aaf14800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787380442.982400:0:12868:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d96aaf15000): rc 0 00000020:00000080:0.0:1787380442.982402:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96aaf15000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787380442.982410:0:12868:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd308383bae0 00000100:00080000:0.0:1787380442.982428:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787380442.982431:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787380442.982449:0:12868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787380442.982508:0:12868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787380442.982530:0:12868:0:(import.c:65:import_set_state_nolock()) ffff9d96b7e45000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787380442.982545:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787380442.982547:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787380442.982553:0:12868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787380442.982631:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935592960:0@lo:9:umount.0 00000100:00100000:0.0:1787380442.982698:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380442.982750:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935592960 00000100:00100000:0.0:1787380442.982757:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935592960 00000100:00100000:0.0:1787380442.982795:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787380442.982804:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1874203935592960:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787380442.982824:0:6577:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188422d8 00000100:00080000:0.0:1787380442.982830:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9d96b7e41000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787380442.982855:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787380442.983068:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3298:x1874203935592960:12345-0@lo:9:umount.0 Request processed in 264us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380442.983076:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1787380442.983680:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380442.983689:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787380442.983717:0:12868:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787380442.983735:0:12868:0:(import.c:65:import_set_state_nolock()) ffff9d9584a94000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787380442.983765:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d96bd4219c0) has no exports 00000100:00100000:1.0:1787380442.983799:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935593088:0@lo:9:umount.0 00000100:00100000:1.0:1787380442.983836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787380442.983876:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96b7e45000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787380442.983885:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787380442.983887:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380442.983891:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935592960:0@lo:9:umount.0 00000100:00100000:1.0:1787380442.984080:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935593088 00000100:00100000:1.0:1787380442.984086:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935593088 00000100:00100000:1.0:1787380442.984128:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380442.984145:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1874203935593088:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787380442.984274:0:6578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188423b1 00000100:00080000:1.0:1787380442.984286:0:6578:0:(import.c:65:import_set_state_nolock()) ffff9d95851d2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380442.984317:0:6578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1787380442.984539:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380442.986254:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3298:x1874203935593088:12345-0@lo:9:umount.0 Request processed in 2106us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380442.986278:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787380442.986324:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d9584a94000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787380442.986333:0:3298:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787380442.986335:0:3298:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787380442.986352:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935593088:0@lo:9:umount.0 00000020:00000080:3.0:1787380442.987556:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd216000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787380442.987606:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96aaf15000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787380442.987630:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96bd217800 for lustre-MDT0000 00000020:00000080:3.0:1787380442.987634:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96aaf14800 for lustre-MDT0000 00010000:00010000:3.0:1787380442.987645:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787380442.997494:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d96bd4219c0) has no exports 00000020:00000080:2.0:1787380443.057221:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d11884218f 00000020:00000080:2.0:1787380443.057238:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d9698891000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787380443.057263:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787380443.058593:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9698891000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787380443.058631:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380443.058642:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787380443.058646:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9d96be433380) has no exports 00000020:00000080:0.0:1787380443.060501:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842188 00000020:00000080:0.0:1787380443.060513:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96a027e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787380443.060668:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96a027e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787380443.060902:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380443.060914:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787380443.060918:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d9698783800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787380443.060948:0:12868:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9698783800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787380443.060954:0:12868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1787380443.642559:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787380444.010508:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00100000:2.0:1787380444.010527:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95d22c36-51bc-485d-88b7-d90632ec1801 00000001:00080000:2.0:1787380444.010534:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787380444.010538:0:5808:0:(genops.c:906:class_export_put()) final put ffff9d9688ff2000/95d22c36-51bc-485d-88b7-d90632ec1801 00000001:00100000:2.0:1787380444.010651:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000001:00080000:2.0:1787380444.010657:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787380444.010674:0:5808:0:(genops.c:906:class_export_put()) final put ffff9d96bfd8b000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:2.0:1787380444.010689:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9688ff2000/95d22c36-51bc-485d-88b7-d90632ec1801 for lustre-MDT0000 00000020:00000080:2.0:1787380444.010738:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bfd8b000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 for lustre-MDT0000 00000020:00000080:2.0:1787380444.010766:0:12642:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d9688ff1000 for lustre-MDT0000 00000020:00000080:2.0:1787380444.010771:0:12642:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96bfd8b800 for lustre-MDT0000 00000001:00100000:1.0:1787380444.040848:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380444.040859:0:6603:0:(genops.c:906:class_export_put()) final put ffff9d96b7e40000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787380444.041615:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:1.0:1787380444.041621:0:6603:0:(genops.c:906:class_export_put()) final put ffff9d9687394000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 00000020:00000080:3.0:1787380444.041672:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96b7e40000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787380444.041716:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96b7e41000 for lustre-OST0000 00000020:00000080:2.0:1787380444.041890:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9687394000/7dca2b77-2f7d-460b-a508-1b61c3cf2401 for lustre-OST0000 00000020:00000080:2.0:1787380444.042131:0:12642:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d9687397800 for lustre-OST0000 00010000:00010000:3.0:1787380444.666752:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787380445.111512:0:12868:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d96933da5a0 - data ffff9d96b1361af8/ffff9d958496c000 00000020:01000000:0.0:1787380445.111622:0:12868:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d968a9a9720 - data ffff9d96acf4a798/ffff9d9698c81c00 00000001:00000004:0.0:1787380445.118779:0:12868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1787380445.230754:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787380445.230761:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787380445.230787:0:12868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787380445.230789:0:12868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787380445.231819:0:6680:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787380445.231826:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1787380445.231836:0:6680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787380445.232984:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787380445.232990:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787380445.233010:0:12868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787380445.233013:0:12868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787380445.234633:0:7757:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787380445.234640:0:7757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787380445.234655:0:7757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787380445.293297:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842157 00000020:00000080:3.0:1787380445.293309:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96bd479000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787380445.294710:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd479000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787380445.295235:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d11884216c 00000020:00000080:3.0:1787380445.295244:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96bd479800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787380445.295263:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787380445.295270:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380445.295277:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787380445.295282:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9d96bd420000) has no exports 00000020:00000080:1.0:1787380445.295569:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd479800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787380445.295978:0:12868:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787380445.295987:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188423aa 00000020:00000080:3.0:1787380445.295992:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d9584a95800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787380445.296035:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787380445.296047:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380445.296054:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787380445.296057:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9d9687733380) has no exports 00000020:00000080:3.0:1787380445.296063:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188423a3 00000020:00000080:3.0:1787380445.296067:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d9584a93800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787380445.296292:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9584a95800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787380445.299616:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9584a93800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787380445.300096:0:12868:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787380445.300101:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787380445.300106:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787380445.300112:0:12868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787380445.300114:0:12868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787380445.300178:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380445.300189:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380445.300199:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188422c3 00000020:00000080:3.0:1787380445.300208:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d95851d3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787380445.300213:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787380445.300220:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380445.300224:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787380445.300227:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9d96877319c0) has no exports 00000020:00000080:3.0:1787380445.300233:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188422bc 00000020:00000080:3.0:1787380445.300236:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96b7e47000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787380445.300601:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d9584a94000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787380445.300610:0:36:0:(genops.c:906:class_export_put()) final put ffff9d9584a97800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380445.300613:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9584a97800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787380445.300618:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380445.300695:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d95851d3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787380445.300700:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96b7e47000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787380445.300962:0:12868:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787380445.300966:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787380445.300969:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787380445.300973:0:12868:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787380445.300976:0:12868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787380445.301193:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380445.301201:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380445.301230:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380445.301234:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380445.301238:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96bbe10000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787380445.301241:0:12868:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bbe10000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787380445.301246:0:12868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380445.301419:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842173 00000020:00000080:3.0:1787380445.301425:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96bd47d000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787380445.301856:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96b7e45000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787380445.301864:0:36:0:(genops.c:906:class_export_put()) final put ffff9d95851fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380445.301866:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d95851fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787380445.301871:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787380445.302064:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787380445.302070:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380445.302077:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787380445.302081:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9d96bd424d40) has no exports 00000020:00000080:3.0:1787380445.302100:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380445.302104:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787380445.302108:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d11884217a 00000020:00000080:3.0:1787380445.302113:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96bd47f000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787380445.302130:0:12868:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d968b549800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787380445.302134:0:12868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d968b549800 3 00000020:01000004:3.0:1787380445.302138:0:12868:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d968b549800 from lustre-MDT0000 00000020:00000080:3.0:1787380445.302155:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380445.302158:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787380445.302161:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96bd47c800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787380445.302163:0:12868:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd47c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787380445.302170:0:12868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787380445.302202:0:12868:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787380445.302205:0:12868:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787380445.302209:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787380445.302211:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380445.302214:0:12868:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787380445.302220:0:12868:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9d9698ddc800 8aaaa441-7de5-4747-b366-e84ba9a288bb 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380445.302226:0:12868:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9d9699048000) has exports, disconnecting them 00000020:00080000:3.0:1787380445.302230:0:12868:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d9698ddc800), last request at 1787380218 00000020:00000080:3.0:1787380445.302244:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842118 00000020:00010000:3.0:1787380445.302248:0:12868:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d9698ddc800: total 2 00000100:00080000:3.0:1787380445.302252:0:12868:0:(import.c:65:import_set_state_nolock()) ffff9d9698dd9000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787380445.302273:0:12868:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d9698ddc800): rc 0 00000020:00080000:3.0:1787380445.302277:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9d9699048000) has no exports 00000100:00100000:3.0:1787380445.302390:0:5779:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d96933cd600:5779] 0 exiting: rc = 1 00000100:00100000:3.0:1787380445.302478:0:5780:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d968ba2d200:5780] 1 exiting: rc = 0 00000020:00010000:2.0:1787380445.302659:0:5775:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d9698ddc800: total 2 00010000:00010000:2.0:1787380445.302692:0:5775:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d9698ddc800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787380445.302723:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b400/0x651a07d11884266d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842666 expref: 9 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302739:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1e800/0x651a07d11884267b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842674 expref: 8 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302752:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163a400/0x651a07d118842230 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842229 expref: 7 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302765:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af54a00/0x651a07d11884246e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842467 expref: 6 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302775:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884241a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842413 expref: 5 pid: 5779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302785:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af54200/0x651a07d118842428 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d118842421 expref: 4 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302795:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2a00/0x651a07d118842436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d11884242f expref: 3 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302814:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1fc00/0x651a07d118842444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x651a07d11884243d expref: 2 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380445.302824:0:5775:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d9698ddc800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787380445.302834:0:5775:0:(genops.c:906:class_export_put()) final put ffff9d9698ddc800/8aaaa441-7de5-4747-b366-e84ba9a288bb 00010000:00010000:2.0:1787380445.302839:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380445.302841:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380445.302843:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787380445.302946:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd47d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787380445.302951:0:36:0:(genops.c:906:class_export_put()) final put ffff9d96bd478800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787380445.302953:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd478800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787380445.302958:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787380445.303193:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd47f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787380445.303199:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9698ddc800/8aaaa441-7de5-4747-b366-e84ba9a288bb for MGS 00000100:00100000:0.0:1787380445.303403:0:5781:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d968ba2da00:5781] 2 exiting: rc = 0 00000100:00100000:3.0:1787380445.303814:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303821:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303829:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303835:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303840:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303845:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303851:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303857:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303864:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303872:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303879:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303884:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303890:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303896:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303902:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303907:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303912:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303929:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303936:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303941:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303947:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303953:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303958:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303962:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303967:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303972:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303977:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303982:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303989:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.303995:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304000:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304005:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304010:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304015:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304030:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304036:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304041:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304045:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304052:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304057:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304063:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304069:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304075:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304080:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304086:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304091:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304096:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304101:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304105:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304110:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304115:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304119:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304137:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304142:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304147:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304152:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304157:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304162:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304168:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304173:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304178:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304183:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304188:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380445.304193:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1787380445.304560:0:12868:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787380445.304564:0:12868:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1787380445.306730:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d9698dd9000 for MGS 00000020:01000000:3.0:1787380445.306817:0:12868:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d96b5d522a0 - data ffff9d96aea03798/ffff9d9688ef3c00 00000020:01000000:3.0:1787380445.306957:0:12868:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d968af49ba0 - data ffff9d96acf5d5e8/ffff9d968b529c00 00000020:00000080:3.0:1787380445.307863:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188420fc 00000020:00000080:3.0:1787380445.307880:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d968bab1000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787380445.307897:0:12868:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d968b549800 from MGS, refs=2 00000020:01000004:3.0:1787380445.307901:0:12868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d968b549800 2 00000020:01000004:3.0:1787380445.307903:0:12868:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d968b549800 from MGS 00000020:00000080:3.0:1787380445.307937:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380445.307944:0:12868:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787380445.307947:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d968bab5000/MGS 00000020:00000080:3.0:1787380445.307949:0:12868:0:(genops.c:865:class_export_destroy()) destroying export ffff9d968bab5000/MGS for MGS 00000020:01000000:3.0:1787380445.307956:0:12868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787380445.308009:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787380445.308013:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380445.308019:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1787380445.308155:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d968bab1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1787380445.308251:0:12868:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d9695a9c000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380445.308258:0:12868:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9d9695a599c0) has exports, disconnecting them 00000020:00080000:3.0:1787380445.308263:0:12868:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d9695a9c000), last request at 1787380219 00000020:00000080:3.0:1787380445.308268:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188421c7 00000020:00080000:3.0:1787380445.308275:0:12868:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d9695a9c000): rc 0 00000020:00000080:3.0:1787380445.308279:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d9695a9c000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787380445.309013:0:12868:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787380445.309020:0:12868:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380445.309036:0:12868:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787380445.309041:0:12868:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787380445.309829:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d9695a9c000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787380445.310175:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380445.310183:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787380445.310189:0:12868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d968b549800 1 00000020:00000080:3.0:1787380445.310195:0:12868:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188420ee 00000020:00000080:3.0:1787380445.310202:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d968bab7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787380445.310633:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96880bb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787380445.310640:0:36:0:(genops.c:906:class_export_put()) final put ffff9d96ba3b0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787380445.310642:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96ba3b0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787380445.310654:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1787380445.310941:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787380445.310946:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380445.310951:0:12868:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787380445.310955:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9d969904b380) has no exports 00000020:00000080:2.0:1787380445.311214:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d968bab7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787380445.365655:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380445.365669:0:12868:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787380445.365674:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d968b54f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787380445.365678:0:12868:0:(genops.c:865:class_export_destroy()) destroying export ffff9d968b54f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787380445.365696:0:12868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787380445.365842:0:12868:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d968b54b000 00000020:01000000:2.0:1787380445.365871:0:12868:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787380445.365876:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380445.365886:0:12868:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787380445.365890:0:12868:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9d9695a58000) has no exports 00000100:00100000:0.0:1787380445.369144:0:5788:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d9698dc8200:5788] 2 exiting: rc = 0 00000100:00100000:3.0:1787380445.369145:0:7761:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d96b51e7000:7761] 3 exiting: rc = 0 00000100:00100000:3.0:1787380445.371458:0:5787:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d9698dc8600:5787] 1 exiting: rc = 0 00000100:00100000:0.0:1787380445.371836:0:5786:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d96933cd800:5786] 0 exiting: rc = 1 00000100:00100000:1.0:1787380445.371909:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371931:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371939:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371947:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371955:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371962:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371970:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371978:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.371996:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372004:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372011:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372016:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372033:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372042:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372050:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372057:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372064:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372071:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372079:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372087:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372098:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372107:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372119:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372281:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372288:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372293:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372299:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372304:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372310:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372316:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372321:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372326:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372333:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372394:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372401:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372405:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372411:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372416:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372422:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372428:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372433:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372439:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372445:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372460:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372466:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372472:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372477:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372483:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372489:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372507:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372511:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372516:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372521:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372526:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372533:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372538:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372544:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372549:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372555:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372561:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372567:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372572:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372578:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.372594:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384044:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d9698dc8c00:5789] 0 exiting: rc = 1 00000100:00100000:1.0:1787380445.384445:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d9698dc8a00:5790] 1 exiting: rc = 0 00000100:00100000:2.0:1787380445.384639:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384646:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384652:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384659:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384668:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384688:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384694:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384698:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384705:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384712:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384717:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384723:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384729:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384740:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384745:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384751:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384758:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384763:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384772:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384777:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384782:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384790:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384795:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384803:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384808:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384816:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384821:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384829:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384835:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384841:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384849:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384854:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384862:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384868:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384877:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384882:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384887:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384896:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384901:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384908:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384931:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384936:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384941:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384950:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384955:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384964:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384969:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384979:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384984:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384993:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.384999:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385009:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385014:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385090:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385097:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385106:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385112:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385116:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385193:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385205:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385211:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385218:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385223:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.385228:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.386196:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d9690aa9400:5791] 0 exiting: rc = 1 00000100:00100000:1.0:1787380445.386389:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d969f178600:5792] 1 exiting: rc = 0 00000100:00100000:2.0:1787380445.386605:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386621:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386629:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386636:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386642:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386649:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386655:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386661:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386669:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386675:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386693:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386709:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386714:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386720:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386725:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386731:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386736:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386742:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386748:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386756:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386762:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386771:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386793:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386800:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386806:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386813:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386819:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386826:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386832:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386838:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386844:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386850:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386857:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386864:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386886:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386898:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386904:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386910:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386933:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386940:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386947:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386956:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386963:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386969:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386974:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.386981:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387013:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387033:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387040:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387047:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387054:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387060:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387067:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387073:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387079:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387085:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387091:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387098:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387119:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387206:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387214:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387220:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387227:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.387233:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.409052:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d969f178000:5793] 0 exiting: rc = 1 00000100:00100000:1.0:1787380445.409154:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d969f178c00:5794] 1 exiting: rc = 0 00000100:00100000:2.0:1787380445.409237:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409244:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409250:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409255:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409260:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409265:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409364:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409372:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409377:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409382:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409388:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409393:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409398:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409403:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409409:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409414:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409419:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409439:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409444:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409449:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409454:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409458:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409463:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409468:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409473:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409478:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409483:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409488:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409574:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409580:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409585:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409590:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409595:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409599:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409604:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409609:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409616:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409622:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409627:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409632:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409638:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409643:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409649:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409654:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409660:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409665:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409670:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409676:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409808:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409816:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409822:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409827:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409839:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409844:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409849:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409854:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409858:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409863:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409868:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409873:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409879:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409883:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409887:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.409892:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.411005:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d96a1c13000:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1787380445.411104:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d969f179e00:5795] 0 exiting: rc = 1 00000100:00100000:2.0:1787380445.411366:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411373:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411377:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411383:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411388:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411393:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411398:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411403:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411408:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411414:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411419:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411424:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411429:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411434:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411441:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411448:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411452:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411457:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411462:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411467:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411471:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411476:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.411480:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412100:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412105:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412111:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412115:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412119:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412245:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412250:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412254:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412259:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412263:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412359:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412368:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412373:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412378:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412382:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412387:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412394:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412400:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412405:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412410:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412414:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412420:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412425:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412429:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412434:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412439:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412445:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412450:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412455:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412459:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412465:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412470:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412475:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412479:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.412484:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.413107:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.413113:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.413117:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.413246:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.413255:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380445.413260:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.413993:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d968779ae00:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1787380445.414738:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d968779be00:5798] 1 exiting: rc = 0 00000100:00100000:1.0:1787380445.414803:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414811:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414817:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414822:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414842:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414848:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414853:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414858:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414863:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414869:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414873:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414879:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414884:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414889:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414894:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414899:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414903:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414908:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414913:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414928:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414935:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414940:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414944:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414949:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414954:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414959:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414964:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414969:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414973:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414977:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414982:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414986:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414990:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.414995:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415000:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415004:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415083:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415088:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415093:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415105:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415110:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415114:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415119:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415123:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415128:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415132:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415137:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415141:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415147:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415152:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415156:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415161:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415166:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415171:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415176:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415180:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415185:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415190:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415194:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415199:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415203:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415208:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415213:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415218:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.415758:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d9689c79400:5801] 2 exiting: rc = 0 00000100:00100000:2.0:1787380445.415803:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d9689c4d000:5799] 0 exiting: rc = 1 00000100:00100000:2.0:1787380445.416592:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d9689c79e00:5800] 1 exiting: rc = 0 00000100:00100000:1.0:1787380445.416692:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416700:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416705:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416710:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416716:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416721:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416726:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416732:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416737:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416762:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416768:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416774:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416779:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416785:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416790:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416796:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416803:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416809:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416814:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416820:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416825:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416831:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416836:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416842:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416847:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416853:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416859:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416864:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416870:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416875:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416881:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416887:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416893:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416910:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416926:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416932:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416938:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416943:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416949:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416954:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416960:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416966:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416972:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416978:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416989:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.416995:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417001:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417082:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417091:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417098:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417104:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417110:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417116:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417121:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417127:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417133:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417139:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417144:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417150:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417155:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417162:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417167:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417172:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380445.417178:0:12868:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787380445.421895:0:12868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380445.421909:0:12868:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787380445.421914:0:12868:0:(genops.c:906:class_export_put()) final put ffff9d96880be800/MDS_uuid 00000020:00000080:1.0:1787380445.421929:0:12868:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96880be800/MDS_uuid for MDS 00000020:01000000:1.0:1787380445.421935:0:12868:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787380445.422200:0:12868:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787380445.687526:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787380446.014229:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380446.014239:0:7479:0:(genops.c:906:class_export_put()) final put ffff9d95851d6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787380446.015263:0:12642:0:(genops.c:865:class_export_destroy()) destroying export ffff9d95851d6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787380446.015325:0:12642:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d95851d2800 for lustre-OST0001 00010000:00010000:2.0:1787380446.712521:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380446.973509:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935593472:0@lo:400:kworker.0 00000400:00000100:3.0:1787380446.973581:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935593472 offset 0 length 224: 4 00000100:00100000:3.0:1787380446.973658:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380446.973665:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935593344:0@lo:400:kworker.0 00000400:00000100:3.0:1787380446.973685:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935593344 offset 0 length 224: 4 00000100:00100000:0.0:1787380446.973771:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935593216:0@lo:400:kworker.0 00000400:00000100:0.0:1787380446.973797:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874203935593216 offset 0 length 224: 4 00010000:00010000:2.0:1787380447.737813:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787380448.535216:0:13022:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787380448.549507:0:13022:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787380448.549552:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380448.549576:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380448.549584:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380448.549591:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380448.549613:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787380448.549618:0:13022:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787380448.549641:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380448.549651:0:13022:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d9585eaaa00 x1874203935593344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380462 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787380448.549766:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380448.549773:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380448.549780:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ec00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1787380448.549783:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380448.549791:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380448.549798:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380448.549804:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380448.549806:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787380448.549809:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787380448.549854:0:5775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380448.549861:0:5775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380448.549892:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380448.549898:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9688e1ec00/0x651a07d11884242f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x651a07d118842436 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380448.549920:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380448.549922:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380448.549924:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380448.550144:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380448.550160:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935593600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380448.550226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380448.550529:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935593600 00000100:00100000:2.0:1787380448.550536:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935593600 00000100:00100000:2.0:1787380448.550581:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380448.550588:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1874203935593600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787380448.550594:0:5773:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787380448 with bad export cookie 7285143941866070296 00000100:00100000:3.0:1787380448.550754:0:13022:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787380448.550762:0:13022:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787380448.550969:0:13022:0:(import.c:65:import_set_state_nolock()) ffff9d95851fd000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787380448.551396:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935593344:0@lo:400:kworker.0 00000100:00100000:0.0:1787380448.551427:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874203935593728:0@lo:39:umount.0 00000400:00000100:0.0:1787380448.551459:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935593728 offset 0 length 224: 4 00000100:00100000:2.0:1787380448.564533:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3300:x1874203935593600:12345-0@lo:103:ldlm_bl.0 Request processed in 13939us (14302us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787380448.564547:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787380448.565988:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.114@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787380448.565996:0:3300:0:(import.c:65:import_set_state_nolock()) ffff9d968bab3000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787380448.566000:0:3300:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.114@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787380448.576527:0:3300:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.114@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787380448.576532:0:3300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787380448.576541:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d9585eab100 x1874203935593216/t0(0) o400->MGC192.168.206.114@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787380462 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380448.576554:0:3300:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d9698da6d80 x1874203935593600/t0(0) o103->MGC192.168.206.114@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787380464 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787380448.576578:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787380448.576581:0:3300:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787380448.576582:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787380448.576587:0:3300:0:(import.c:65:import_set_state_nolock()) ffff9d968bab3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380448.576591:0:3300:0:(import.c:510:import_select_connection()) MGC192.168.206.114@tcp: connect to NID 0@lo last attempt 168 00000100:00080000:0.0:1787380448.576600:0:3300:0:(import.c:624:import_select_connection()) MGC192.168.206.114@tcp: import ffff9d968bab3000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1787380448.576627:0:3300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9587461c00 x1874203935593856/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787380448.576674:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935593216:0@lo:400:kworker.0 00000100:00100000:0.0:1787380448.576702:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aaaa441-7de5-4747-b366-e84ba9a288bb:3300:1874203935593600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380448.576766:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aaaa441-7de5-4747-b366-e84ba9a288bb:3298:1874203935593856:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1787380448.576811:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874203935593856 offset 0 length 520: 4 00010000:00010000:2.0:1787380448.760520:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380449.783682:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380450.807951:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380451.831525:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380452.087587:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787380452.087599:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787380452.088081:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935593984:0@lo:400:kworker.0 00000400:00000100:2.0:1787380452.088135:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935593984 offset 0 length 224: 4 00010000:00010000:2.0:1787380452.855782:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787380453.112247:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787380453.112272:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787380453.112423:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935594112:0@lo:400:kworker.0 00000400:00000100:2.0:1787380453.112475:0:3301:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935594112 offset 0 length 224: 4 00010000:00010000:2.0:1787380453.880011:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380454.903561:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380455.927587:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380456.951601:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380457.977981:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787380458.231664:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787380458.231674:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380458.231782:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935594240:0@lo:400:kworker.0 00000400:00000100:0.0:1787380458.231835:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935594240 offset 0 length 224: 4 00000100:00100000:2.0:1787380458.743468:0:3298:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380448/real 1787380448] req@ffff9d9587461c00 x1874203935593856/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787380458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380458.743501:0:3298:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d9587461c00 x1874203935593856/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787380458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380458.743511:0:3298:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380448/real 1787380448] req@ffff9d9585eaad80 x1874203935593728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380458.743523:0:3298:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d9585eaad80 x1874203935593728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787380458.743539:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d968bab3000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787380458.743556:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787380458.743559:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aaaa441-7de5-4747-b366-e84ba9a288bb:3298:1874203935593856:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1787380458.743565:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d95851fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787380458.743693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787380458.743697:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787380458.743700:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d968bab3000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787380458.743704:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.114@tcp: connect to NID 0@lo last attempt 398 00000100:00080000:1.0:1787380458.743709:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.114@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787380458.743731:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.114@tcp: import ffff9d968bab3000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1787380458.743758:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d96b5114000 x1874203935594368/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787380458.743976:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380458.743988:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935594496:0@lo:400:kworker.0 00000400:00000100:1.0:1787380458.744030:0:3300:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935594496 offset 0 length 224: 4 00000100:00100000:2.0:1787380458.745588:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874203935593728:0@lo:39:umount.0 00000100:00100000:2.0:1787380458.745626:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aaaa441-7de5-4747-b366-e84ba9a288bb:3298:1874203935594368:0@lo:250:kworker.0 00000400:00000100:2.0:1787380458.745674:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874203935594368 offset 0 length 520: 4 00000100:00080000:3.0:1787380458.755853:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380458.755862:0:13022:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787380458.755869:0:13022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787380458.756863:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.756877:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.756885:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.756890:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.756915:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380458.756921:0:13022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.756927:0:13022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.756933:0:13022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.756939:0:13022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380458.757076:0:13022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787380458.757081:0:13022:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787380458.757104:0:13022:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787380458.757108:0:13022:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787380458.757113:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380458.757117:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787380458.757121:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d96be4319c0) has no exports 00000020:00080000:3.0:1787380458.757143:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d96be4319c0) has no exports 00000020:01000000:3.0:1787380458.764230:0:13022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d96933daba0 - data ffff9d96b1332288/ffff9d96b527b800 00000020:01000000:3.0:1787380458.764575:0:13022:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d9586d101e0 - data ffff9d96b1290e58/ffff9d96be426800 00010000:00010000:0.0:1787380458.765142:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380458.765152:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765163:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380458.765167:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765178:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380458.765185:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380458.765208:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380458.765210:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787380458.765213:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787380458.765229:0:5775:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d968bab3000 00010000:00010000:0.0:1787380458.765232:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765238:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968af55a00/0x651a07d11884243d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d118842444 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765269:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380458.765273:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765279:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380458.765281:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765287:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380458.765293:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380458.765298:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787380458.765299:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787380458.765301:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787380458.765306:0:5775:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d968bab3000 00010000:00010000:0.0:1787380458.765308:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765321:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968163a600/0x651a07d118842674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d11884267b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380458.765330:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380458.765331:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380458.765333:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380458.769269:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787380458.779465:0:13022:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787380458.811552:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d11884224c 00000020:00000080:3.0:1787380458.811562:0:13022:0:(genops.c:906:class_export_put()) final put ffff9d96b7e44000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787380458.811579:0:13022:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d96ba3b2800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787380458.811582:0:13022:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d96ba3b2800 2 00000020:01000004:3.0:1787380458.811585:0:13022:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d96ba3b2800 from lustre-OST0000 00000020:00000080:3.0:1787380458.811609:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380458.811618:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787380458.811621:0:13022:0:(genops.c:906:class_export_put()) final put ffff9d96b7e44800/lustre-OST0000_UUID 00000020:00000080:3.0:1787380458.811623:0:13022:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96b7e44800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787380458.811630:0:13022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787380458.811666:0:13022:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787380458.811670:0:13022:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787380458.811674:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380458.811678:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787380458.811684:0:13022:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d95851f9000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380458.811690:0:13022:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9d96be434d40) has exports, disconnecting them 00000020:00080000:3.0:1787380458.811694:0:13022:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d95851f9000), last request at 1787380236 00000020:00000080:3.0:1787380458.811710:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842276 00000020:00080000:3.0:1787380458.811720:0:13022:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d95851f9000): rc 0 00000020:00000080:3.0:1787380458.811724:0:13022:0:(genops.c:906:class_export_put()) final put ffff9d95851f9000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787380458.812148:0:1362:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96b7e44000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787380458.812161:0:1362:0:(genops.c:865:class_export_destroy()) destroying export ffff9d95851f9000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787380458.814413:0:13022:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787380458.814420:0:13022:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787380458.814424:0:13022:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787380458.814430:0:13022:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787380458.814577:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380458.814585:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787380458.814591:0:13022:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d96ba3b2800 1 00000020:00000080:2.0:1787380458.814597:0:13022:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842206 00000020:00000080:2.0:1787380458.814604:0:13022:0:(genops.c:906:class_export_put()) final put ffff9d96988c6000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787380458.814609:0:13022:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787380458.814614:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380458.814619:0:13022:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787380458.814622:0:13022:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9d9695a5cd40) has no exports 00000020:00000080:1.0:1787380458.815240:0:1362:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d95851fd000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787380458.815248:0:1362:0:(genops.c:906:class_export_put()) final put ffff9d96b7e46000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787380458.815254:0:1362:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96b7e46000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787380458.815260:0:1362:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787380458.815312:0:1362:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96988c6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787380458.842240:0:13022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380458.842256:0:13022:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787380458.842262:0:13022:0:(genops.c:906:class_export_put()) final put ffff9d96afd3b000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787380458.842266:0:13022:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96afd3b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787380458.842276:0:13022:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787380458.842511:0:13022:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d96ba3b6000 00000020:02000400:2.0:1787380458.842585:0:13022:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787380459.000476:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380460.024770:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380461.047436:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787380461.460227:0:13174:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787380461.472449:0:13174:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787380461.472522:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472536:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472542:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472561:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472576:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787380461.472580:0:13174:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787380461.472602:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380461.472608:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472614:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55200 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1787380461.472618:0:5774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472626:0:5774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380461.472633:0:5774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380461.472638:0:5774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380461.472641:0:5774:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787380461.472643:0:5774:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787380461.472655:0:5774:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d968bab3000 00010000:00010000:2.0:1787380461.472658:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472665:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d968af55200/0x651a07d118842413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d11884241a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380461.472684:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380461.472686:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380461.472687:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787380461.472700:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787380461.472710:0:13174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d9585ea9500 x1874203935593472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380462 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380461.472733:0:13174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d9587460000 x1874203935593984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380468 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380461.472747:0:13174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d9585ea9f80 x1874203935594112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380469 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380461.472758:0:13174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d9585eaa300 x1874203935594240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380474 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380461.472766:0:13174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d96b5116680 x1874203935594496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380474 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380461.472773:0:13174:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787380461.472803:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935594496:0@lo:400:kworker.0 00000100:00100000:2.0:1787380461.472811:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3300:1874203935593984:0@lo:400:kworker.0 00000100:00100000:3.0:1787380461.473374:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935594240:0@lo:400:kworker.0 00000100:00100000:3.0:1787380461.473388:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935593472:0@lo:400:kworker.0 00000100:00100000:2.0:1787380461.473703:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3301:1874203935594112:0@lo:400:kworker.0 00000100:00080000:2.0:1787380461.473720:0:13174:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787380461.473741:0:13174:0:(import.c:65:import_set_state_nolock()) ffff9d96bbe10800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787380461.475475:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874203935594624:0@lo:39:umount.0 00000400:00000100:3.0:1787380461.475533:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203935594624 offset 0 length 224: 4 00010000:00010000:1.0:1787380462.075228:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380463.102641:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787380463.864591:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787380463.864602:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787380464.119465:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380465.147246:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380466.167489:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380467.191851:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380468.215744:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787380468.985513:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787380468.985537:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787380469.239633:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380470.263555:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380471.287581:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380471.671481:0:3298:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380461/real 1787380461] req@ffff9d9698da5c00 x1874203935594624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380471 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380471.671524:0:3298:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d9698da5c00 x1874203935594624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380471 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787380471.671546:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96bbe10800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787380471.671569:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874203935594624:0@lo:39:umount.0 00000100:00080000:2.0:1787380471.671715:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787380471.671720:0:13174:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787380471.671725:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787380471.672852:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.672867:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.672873:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.672879:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.672958:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380471.672966:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.672973:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.672988:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.672994:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.677130:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380471.677145:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.677157:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96813f3200 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380471.677162:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.677195:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380471.677202:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380471.677207:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787380471.677210:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787380471.677234:0:5775:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d968bab3000 00010000:00010000:1.0:1787380471.677238:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.677244:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f3200/0x651a07d118842421 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d118842428 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.677266:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380471.677270:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.677276:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380471.677278:0:5775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380471.677845:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1787380471.677858:0:13174:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787380471.677864:0:13174:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787380471.677894:0:13174:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787380471.677898:0:13174:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787380471.677906:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380471.677912:0:13174:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787380471.677917:0:13174:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9d96bd423380) has no exports 00010000:00010000:3.0:1787380471.678046:0:5774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787380471.678098:0:13174:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9d96bd423380) has no exports 00010000:00010000:1.0:1787380471.678309:0:5775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380471.678317:0:5775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380471.678351:0:5775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787380471.678354:0:5775:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787380471.678356:0:5775:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787380471.678370:0:5775:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d968bab3000 00010000:00010000:1.0:1787380471.678374:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.678380:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d118842666 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d11884266d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380471.678396:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380471.678398:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380471.678399:0:5775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787380471.681196:0:13174:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d96933da2a0 - data ffff9d9584d60000/ffff9d96b527bc00 00000020:01000000:2.0:1787380471.681404:0:13174:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d9691f47120 - data ffff9d96aea0e1b0/ffff9d9584969800 00100000:10000000:3.0:1787380471.699053:0:13174:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787380471.733440:0:13174:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842317 00000020:00000080:0.0:1787380471.733448:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d96bd210800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787380471.733551:0:13174:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d969f0ea800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787380471.733563:0:13174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d969f0ea800 2 00000020:01000004:0.0:1787380471.733566:0:13174:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d969f0ea800 from lustre-OST0001 00000020:00000080:0.0:1787380471.734005:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380471.734016:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787380471.734019:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d969f0ef800/lustre-OST0001_UUID 00000020:00000080:0.0:1787380471.734023:0:13174:0:(genops.c:865:class_export_destroy()) destroying export ffff9d969f0ef800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787380471.734030:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787380471.734143:0:13174:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8aaaa441-7de5-4747-b366-e84ba9a288bb->MGS 00010000:00010000:0.0:1787380471.734158:0:13174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d118842230 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380471.734169:0:13174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d118842230 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380471.734175:0:13174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787380471.734178:0:13174:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787380471.734181:0:13174:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787380471.734193:0:13174:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d968bab3000 00010000:00010000:0.0:1787380471.734197:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f2c00/0x651a07d118842229 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d118842230 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380471.734224:0:13174:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x651a07d11884246e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380471.734231:0:13174:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x651a07d11884246e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380471.734236:0:13174:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380471.734237:0:13174:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787380471.734239:0:13174:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787380471.734248:0:13174:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d968bab3000 00010000:00010000:0.0:1787380471.734251:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96813f2e00/0x651a07d118842467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x651a07d11884246e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787380471.734266:0:13174:0:(import.c:65:import_set_state_nolock()) ffff9d968bab3000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787380471.734271:0:13174:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787380471.734273:0:13174:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787380471.734274:0:13174:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787380471.734278:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787380471.734287:0:13174:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d96b5114000 x1874203935594368/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787380473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787380471.734312:0:13174:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787380471.734315:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1787380471.734397:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aaaa441-7de5-4747-b366-e84ba9a288bb:3298:1874203935594368:0@lo:250:kworker.0 10000000:01000000:0.0:1787380471.735026:0:13174:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787380471.735035:0:13174:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d11884210a 00000020:00000080:0.0:1787380471.735041:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d968bab1800/8aaaa441-7de5-4747-b366-e84ba9a288bb 00000020:00000080:1.0:1787380471.740841:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96bd210800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787380471.741045:0:13174:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.206.114@tcp (flags='') 00000020:00000080:0.0:1787380471.741070:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380471.741077:0:13174:0:(obd_config.c:955:class_cleanup()) MGC192.168.206.114@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787380471.741082:0:13174:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9d9695a5b380) has no exports 10000000:01000000:2.0:1787380471.741152:0:5783:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787380471.741439:0:13174:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.114@tcp: client import never connected 00000100:00080000:0.0:1787380471.741456:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787380471.741460:0:13174:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787380471.741471:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787380471.741474:0:13174:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787380471.745156:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d968bab1800/8aaaa441-7de5-4747-b366-e84ba9a288bb for MGC192.168.206.114@tcp 00000020:00000080:0.0:1787380471.746112:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380471.746124:0:13174:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.114@tcp (uuid 8aaaa441-7de5-4747-b366-e84ba9a288bb) 00000020:01000000:0.0:1787380471.746132:0:13174:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787380471.746140:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380471.746146:0:13174:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787380471.746154:0:13174:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d96aaf17800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787380471.746160:0:13174:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9d96990499c0) has exports, disconnecting them 00000020:00080000:0.0:1787380471.746165:0:13174:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d96aaf17800), last request at 1787380255 00000020:00000080:0.0:1787380471.746170:0:13174:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d118842341 00000020:00080000:0.0:1787380471.746188:0:13174:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d96aaf17800): rc 0 00000020:00000080:0.0:1787380471.746193:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d96aaf17800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787380471.748963:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d968bab3000 for MGC192.168.206.114@tcp 00000020:00000080:1.0:1787380471.748983:0:36:0:(genops.c:906:class_export_put()) final put ffff9d96880bd000/8aaaa441-7de5-4747-b366-e84ba9a288bb 00000020:00000080:1.0:1787380471.748986:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96880bd000/8aaaa441-7de5-4747-b366-e84ba9a288bb for MGC192.168.206.114@tcp 00000020:01000000:1.0:1787380471.748995:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.114@tcp (8aaaa441-7de5-4747-b366-e84ba9a288bb) 00000020:00000080:1.0:1787380471.756658:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96aaf17800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787380471.767406:0:13174:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787380471.767416:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787380471.767420:0:13174:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787380471.767427:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787380471.768012:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d96bbe10800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787380471.786423:0:5774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787380471.786745:0:5775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1787380471.786855:0:8291:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9d96b7e4c400:8291] 2 exiting: rc = 0 00000100:00100000:1.0:1787380471.786906:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d968a684000:5769] 0 exiting: rc = 1 00000100:00100000:1.0:1787380471.786962:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d968d64fc00:5770] 1 exiting: rc = 0 00000100:00100000:1.0:1787380471.787011:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.787018:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.787251:0:5772:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d9698fc9800:5772] 1 exiting: rc = 0 00000100:00100000:2.0:1787380471.787446:0:11008:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9d96b5a3f800:11008] 4 exiting: rc = 0 00000100:00100000:2.0:1787380471.787519:0:5773:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d9698fc9c00:5773] 2 exiting: rc = 0 00000100:00100000:2.0:1787380471.787768:0:8292:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d96b51e7400:8292] 3 exiting: rc = 0 00000100:00100000:3.0:1787380471.793180:0:5771:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d968d64ec00:5771] 0 exiting: rc = 1 00000100:00100000:1.0:1787380471.793448:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793456:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793475:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793481:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793486:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793492:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793496:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793502:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793508:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793514:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793519:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793524:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793530:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793535:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793551:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793566:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793572:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793579:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793584:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793589:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793596:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793601:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793607:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793612:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793618:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793622:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793628:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793633:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793637:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793642:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793646:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793663:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793668:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793673:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793678:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793683:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793688:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793693:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793698:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793703:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793708:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793713:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793719:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793724:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793729:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793734:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793740:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793745:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793750:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793755:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793760:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793765:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793771:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793786:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793792:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793797:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793803:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793809:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793814:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793819:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793825:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793833:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793839:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.793844:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787380471.796485:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380471.796497:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787380471.796515:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d96aaf12000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787380471.796521:0:13174:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96aaf12000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787380471.796528:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787380471.796752:0:13174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d969f0ea800 1 00000020:00000080:1.0:1787380471.796758:0:13174:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x651a07d1188422e6 00000020:00000080:1.0:1787380471.796763:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d969f0ea000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787380471.796788:0:13174:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787380471.796794:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380471.796798:0:13174:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787380471.796802:0:13174:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9d9687734d40) has no exports 00000020:00000080:2.0:1787380471.796896:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d969f0ea000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787380471.854938:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380471.854953:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787380471.854959:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d969f0e9000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787380471.854964:0:13174:0:(genops.c:865:class_export_destroy()) destroying export ffff9d969f0e9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787380471.854991:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787380471.855171:0:13174:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d969f0ec000 00000020:01000000:2.0:1787380471.855196:0:13174:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787380471.855200:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380471.855204:0:13174:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787380471.855564:0:13174:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9d96be430000) has no exports 00000020:00000080:2.0:1787380471.856061:0:13174:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380471.856071:0:13174:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787380471.856074:0:13174:0:(genops.c:906:class_export_put()) final put ffff9d96988c5000/OSS_uuid 00000020:00000080:2.0:1787380471.856077:0:13174:0:(genops.c:865:class_export_destroy()) destroying export ffff9d96988c5000/OSS_uuid for OSS 00000020:01000000:2.0:1787380471.856084:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1787380471.857379:0:8465:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d95858ce400:8465] 3 exiting: rc = 0 00000100:00100000:2.0:1787380471.857468:0:6577:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d96bd0ec600:6577] 1 exiting: rc = 0 00000100:00080000:1.0:1787380471.861280:0:5782:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787380471.861470:0:6576:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d96b55d0200:6576] 0 exiting: rc = 1 00000100:00100000:0.0:1787380471.863824:0:6578:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d96bd0ec200:6578] 2 exiting: rc = 0 00000100:00100000:2.0:1787380471.870215:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870227:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870233:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870240:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870246:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870251:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870256:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870261:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870265:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870270:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870274:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870279:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870284:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870288:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870293:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870297:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870301:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870307:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870312:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870317:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870323:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870328:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870332:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870349:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870354:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870359:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870363:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870383:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870387:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870392:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870396:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870401:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870406:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870415:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870423:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870427:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870432:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870437:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870442:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870446:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870452:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870457:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870476:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870489:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870495:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870500:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870507:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870512:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870517:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870522:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870526:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870532:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870536:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870541:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870546:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870554:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870559:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870566:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870573:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870579:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870584:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870589:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870600:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.870605:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.874290:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d96b55d1600:6581] 1 exiting: rc = 0 00000100:00100000:1.0:1787380471.874475:0:6580:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d96b55d1a00:6580] 0 exiting: rc = 1 00000100:00100000:2.0:1787380471.895791:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895802:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895807:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895813:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895818:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895823:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895828:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895833:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895838:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895844:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895850:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895855:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895859:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895864:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895869:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895874:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895879:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895884:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895889:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895894:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895899:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895904:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895908:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895912:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895916:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895921:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895928:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895934:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895939:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895945:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895950:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895955:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895960:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895978:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895983:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895988:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895994:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.895999:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896003:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896007:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896012:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896017:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896022:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896044:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896051:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896055:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896060:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896065:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896070:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896075:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896080:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896085:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896091:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896097:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896102:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896106:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896111:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896117:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896122:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896127:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896133:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896137:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896143:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.896148:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.897583:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d96bd1cd600:6582] 0 exiting: rc = 1 00000100:00100000:2.0:1787380471.897907:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d96bd1cc200:6584] 2 exiting: rc = 0 00000100:00100000:0.0:1787380471.898251:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d96bd1cc600:6583] 1 exiting: rc = 0 00000100:00100000:2.0:1787380471.898600:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898607:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898613:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898627:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898631:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898637:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898642:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898647:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898652:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898657:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898662:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898667:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898672:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898678:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898683:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898688:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898693:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898699:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898703:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898708:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898713:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898730:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898736:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898741:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898746:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898751:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898756:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898761:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898766:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898770:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898787:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898792:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898798:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898803:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898809:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898815:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898820:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898826:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898838:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898843:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898850:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898855:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898860:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898864:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898870:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898888:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898894:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898900:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898905:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898910:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898915:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898920:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898925:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898933:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898938:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898944:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898952:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898960:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898965:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898970:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898975:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898980:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898985:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.898999:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380471.904398:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d96afdfd600:6585] 0 exiting: rc = 1 00000100:00100000:1.0:1787380471.904515:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d96ba151400:6586] 1 exiting: rc = 0 00000100:00100000:2.0:1787380471.904673:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904679:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904685:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904690:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904695:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904700:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904706:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904710:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904715:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904792:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904797:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904801:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904806:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904811:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904815:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904821:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904825:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904830:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904835:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904840:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904845:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904850:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904857:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904861:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904866:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904871:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904876:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904880:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904885:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904890:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904895:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904900:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904905:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904910:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904915:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904920:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904925:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904930:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904935:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904939:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904943:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904948:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904954:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904958:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904971:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904976:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904981:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904986:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904992:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.904997:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905002:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905007:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905012:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905016:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905021:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905025:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905040:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905045:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905049:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905054:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905058:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905062:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905067:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.905072:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906192:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d96bfd84a00:6588] 1 exiting: rc = 0 00000100:00100000:1.0:1787380471.906364:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d96bd1cca00:6587] 0 exiting: rc = 1 00000100:00100000:2.0:1787380471.906458:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906534:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906551:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906557:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906563:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906568:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906574:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906579:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906585:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906590:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906596:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906602:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906608:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906615:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906643:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906649:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906655:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906662:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906667:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906672:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906678:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906683:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906688:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906694:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906699:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906705:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906723:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906729:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906735:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906740:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906746:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906750:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906755:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906760:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906765:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906770:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906787:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906792:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906808:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906815:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906820:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906825:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906830:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906835:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906840:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906845:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906851:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906856:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906861:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906872:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906890:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906895:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906901:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906906:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906912:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906918:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906924:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906929:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906935:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906940:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906945:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906951:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906957:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380471.906972:0:13174:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787380471.915805:0:13174:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787380487.938846:0:13790:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787380496.211466:0:14203:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787380496.211471:0:14203:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787380496.212103:0:14203:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d96bcdf7800 00000020:01000004:2.0:1787380496.212120:0:14203:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787380496.212127:0:14203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787380496.212149:0:14203:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d9687734d40) 00000020:00000080:2.0:1787380496.212162:0:14203:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787380496.239665:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787380496.246753:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787380496.247782:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787380496.247991:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 401: rc = 0 00100000:10000000:3.0:1787380496.248170:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 401: rc = 0 00100000:10000000:3.0:1787380496.248261:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 401: rc = 0 00100000:10000000:3.0:1787380496.248536:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 401: rc = 0 00100000:10000000:3.0:1787380496.248650:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 401: rc = 0 00100000:10000000:3.0:1787380496.248753:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 401: rc = 0 00100000:10000000:3.0:1787380496.249190:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 403: rc = 0 00100000:10000000:3.0:1787380496.250723:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:3.0:1787380496.250829:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:2.0:1787380496.255735:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1787380496.256059:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1787380496.256625:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:2.0:1787380496.256896:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:2.0:1787380496.257375:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:2.0:1787380496.259630:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1787380496.259927:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:2.0:1787380496.260180:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1787380496.260475:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1787380496.261703:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1787380496.261959:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1787380496.262381:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 644: rc = 0 00100000:10000000:2.0:1787380496.262881:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 783: rc = 0 00100000:10000000:2.0:1787380496.263888:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 783: rc = 0 00100000:10000000:2.0:1787380496.264272:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 783: rc = 0 00100000:10000000:2.0:1787380496.264727:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 783: rc = 0 00100000:10000000:2.0:1787380496.264985:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 783: rc = 0 00100000:10000000:2.0:1787380496.267151:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 783: rc = 0 00100000:10000000:2.0:1787380496.267764:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 783: rc = 0 00100000:10000000:2.0:1787380496.268007:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 783: rc = 0 00100000:10000000:2.0:1787380496.268709:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 783: rc = 0 00100000:10000000:2.0:1787380496.268979:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 783: rc = 0 00100000:10000000:2.0:1787380496.269415:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 783: rc = 0 00100000:10000000:2.0:1787380496.269684:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 783: rc = 0 00100000:10000000:2.0:1787380496.269930:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 783: rc = 0 00100000:10000000:2.0:1787380496.272696:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 783: rc = 0 00100000:10000000:2.0:1787380496.277323:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 783: rc = 0 00100000:10000000:2.0:1787380496.277926:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 783: rc = 0 00100000:10000000:2.0:1787380496.279991:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 783: rc = 0 00100000:10000000:2.0:1787380496.280256:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 783: rc = 0 00100000:10000000:2.0:1787380496.280534:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 783: rc = 0 00100000:10000000:2.0:1787380496.280801:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 783: rc = 0 00100000:10000000:2.0:1787380496.281050:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 783: rc = 0 00100000:10000000:2.0:1787380496.281308:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 783: rc = 0 00100000:10000000:2.0:1787380496.284820:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 783: rc = 0 00100000:10000000:2.0:1787380496.285711:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 783: rc = 0 00100000:10000000:2.0:1787380496.285981:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 783: rc = 0 00100000:10000000:2.0:1787380496.286940:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 783: rc = 0 00100000:10000000:2.0:1787380496.287332:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 783: rc = 0 00100000:10000000:3.0:1787380496.287913:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 783: rc = 0 00100000:10000000:3.0:1787380496.288189:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 783: rc = 0 00100000:10000000:3.0:1787380496.288493:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 783: rc = 0 00100000:10000000:3.0:1787380496.288758:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 783: rc = 0 00100000:10000000:3.0:1787380496.289012:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 783: rc = 0 00100000:10000000:3.0:1787380496.290615:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 541: rc = 0 00100000:10000000:3.0:1787380496.291781:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787380496.291978:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:3.0:1787380496.292528:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787380496.292605:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:3.0:1787380496.292810:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787380496.292881:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:3.0:1787380496.293793:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787380496.293871:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:3.0:1787380496.294054:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787380496.294133:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:3.0:1787380496.294311:0:14203:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787380496.294404:0:14203:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00000020:00000080:3.0:1787380496.294769:0:14203:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787380496.294778:0:14203:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787380496.294788:0:14203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d11884340b 00000020:01000004:3.0:1787380496.294804:0:14203:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787380496.294809:0:14203:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787380496.294813:0:14203:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d96bcdf7800 from MGS 00000020:01000004:3.0:1787380496.294817:0:14203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787380496.294825:0:14203:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d96bd4219c0) 00000020:00000080:3.0:1787380496.294835:0:14203:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787380496.294884:0:14203:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96bcdf7800 from MGS, refs=2 00080000:01000000:3.0:1787380496.294888:0:14203:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787380496.294892:0:14203:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d118843419 00000100:00100000:3.0:1787380496.294981:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787380496.295095:0:14203:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787380496.295101:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787380496.302560:0:14203:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787380496.302577:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787380496.303620:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380496.303790:0:14203:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787380496.303795:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787380496.307690:0:14203:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787380496.307703:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787380496.308280:0:14203:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787380496.308287:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787380496.311515:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380496.311520:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380496.311522:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380496.312923:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380496.312928:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380496.312930:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380496.313852:0:14203:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787380496.319372:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787380496.337754:0:14203:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787380496.337770:0:14203:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787380496.337773:0:14203:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787380496.342465:0:14212:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787380496.344335:0:14203:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787380496.344485:0:14203:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787380496.344974:0:14203:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787380496.345263:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380496.345429:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787380496.345435:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787380496.354363:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787380496.354373:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787380496.355371:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787380496.355381:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787380496.356323:0:14203:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787380496.356374:0:14203:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.114@tcp' 00000020:01000004:1.0:1787380496.356376:0:14203:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787380496.356404:0:14203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.114@tcp (typ=mgc) 00000020:00000080:1.0:1787380496.356415:0:14203:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.114@tcp (ffff9d96990499c0) 00000020:00000080:1.0:1787380496.356661:0:14203:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787380496.356735:0:14203:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d96897a1800@MGC192.168.206.114@tcp: add connection 192.168.206.114@tcp at head 00010000:00010000:1.0:1787380496.356872:0:14203:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.114@tcp-0 is initialized 00000040:01000000:1.0:1787380496.356877:0:14203:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787380496.356988:0:14217:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787380496.363760:0:14218:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787380496.363836:0:14203:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.114@tcp (uuid c6627fe6-651b-4b45-bfed-0a36822f804a) 00000020:00000080:3.0:1787380496.363856:0:14203:0:(genops.c:1406:class_connect()) connect: client c6627fe6-651b-4b45-bfed-0a36822f804a, cookie 0x651a07d118843427 00000100:00080000:3.0:1787380496.363866:0:14203:0:(import.c:510:import_select_connection()) MGC192.168.206.114@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380496.363871:0:14203:0:(import.c:624:import_select_connection()) MGC192.168.206.114@tcp: import ffff9d96897a1800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1787380496.363899:0:14203:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9585ea9500 x1874203935594752/t0(0) o250->MGC192.168.206.114@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380496.363942:0:14203:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c6627fe6-651b-4b45-bfed-0a36822f804a->MGS 00000020:01000004:3.0:1787380496.363961:0:14203:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787380496.363966:0:14203:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787380496.363978:0:14203:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d96bd420000) 00000020:00000080:3.0:1787380496.363989:0:14203:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787380496.366546:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c6627fe6-651b-4b45-bfed-0a36822f804a:3298:1874203935594752:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787380496.366622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.368775:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935594752 00000100:00100000:2.0:1787380496.368787:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935594752 00000100:00100000:2.0:1787380496.368825:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380496.368833:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3298:x1874203935594752:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787380496.368858:0:14214:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c6627fe6-651b-4b45-bfed-0a36822f804a@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1787380496.368886:0:14214:0:(genops.c:1406:class_connect()) connect: client c6627fe6-651b-4b45-bfed-0a36822f804a, cookie 0x651a07d118843435 00000100:00080000:2.0:1787380496.369002:0:14214:0:(import.c:65:import_set_state_nolock()) ffff9d96bcdf7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380496.369078:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+5:3298:x1874203935594752:12345-0@lo:250:mount.lustre.0 Request processed in 244us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.369099:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380496.369135:0:3298:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.206.114@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787380496.369143:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.114@tcp: connect to target with instance 0 00000100:00080000:2.0:1787380496.369149:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.114@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787380496.369153:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787380496.369157:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96897a1800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787380496.369159:0:3298:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787380496.369177:0:3298:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787380496.369183:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c6627fe6-651b-4b45-bfed-0a36822f804a:3298:1874203935594752:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787380496.387863:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380496.388026:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787380496.388032:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787380496.395714:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380496.395725:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787380496.396043:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787380496.396050:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787380496.397041:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380496.398043:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787380496.398051:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787380496.398942:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787380496.398951:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787380496.452656:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380496.452955:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787380496.452963:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787380496.454491:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787380496.454501:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787380496.455162:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380496.455532:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787380496.455537:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787380496.455955:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787380496.455962:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787380496.456630:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380496.456807:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787380496.456812:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787380496.457538:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787380496.457626:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787380496.458470:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380496.458620:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787380496.458625:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787380496.459235:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787380496.459242:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787380496.483779:0:14203:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380496.484905:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787380496.484915:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787380496.486360:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380496.486375:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787380496.487246:0:14203:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787380496.487258:0:14203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787380496.492785:0:14203:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787380496.492820:0:14203:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787380496.492825:0:14203:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787380496.492945:0:14203:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787380496.492991:0:14203:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.114@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787380496.492996:0:14203:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787380496.492998:0:14203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380496.492999:0:14203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380496.493000:0:14203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380496.493002:0:14203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380496.493003:0:14203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380496.493004:0:14203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380496.493006:0:14203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380496.493007:0:14203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380496.493011:0:14203:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380496.493014:0:14203:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787380496.493016:0:14203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380496.493017:0:14203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380496.493018:0:14203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380496.493019:0:14203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380496.493020:0:14203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380496.493021:0:14203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380496.493022:0:14203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380496.493023:0:14203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380496.493024:0:14203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380496.493025:0:14203:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380496.493047:0:14203:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787380496.493066:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935594880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787380496.493412:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.493586:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd0fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1787380496.495727:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935594880 00000100:00100000:0.0:1787380496.495741:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935594880 00000100:00100000:0.0:1787380496.495845:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380496.495854:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+5:14203:x1874203935594880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787380496.495906:0:14216:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787380496.495909:0:14216:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787380496.495913:0:14216:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787380496.496529:0:14237:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787380496.497032:0:14216:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787380496.499222:0:14238:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787380496.499230:0:14238:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787380496.499233:0:14238:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787380496.499280:0:14238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787380496.499631:0:14216:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787380496.499722:0:14216:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787380496.534961:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+5:14203:x1874203935594880:12345-0@lo:253:mount.lustre.0 Request processed in 39099us (41540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.534974:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380496.535139:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935594880:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787380496.535152:0:14203:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787380496.535156:0:14203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380496.535158:0:14203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380496.535159:0:14203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380496.535161:0:14203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380496.535162:0:14203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380496.535163:0:14203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380496.535165:0:14203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380496.535166:0:14203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380496.535168:0:14203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380496.535169:0:14203:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787380496.535187:0:14203:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d96bcdf7800 from lustre-MDT0000 10000000:01000000:1.0:1787380496.535213:0:14203:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787380496.535216:0:14203:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787380496.535220:0:14203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d96990499c0 10000000:01000000:1.0:1787380496.535224:0:14203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380496.535230:0:14203:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d96990499c0 from 1 10000000:01000000:1.0:1787380496.535233:0:14203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787380496.535267:0:14203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.535291:0:14203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.535301:0:14203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380496.535319:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380496.535374:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.535403:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd0fa600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380496.535465:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935595008 00000100:00100000:2.0:1787380496.535473:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935595008 00000100:00100000:2.0:1787380496.535514:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380496.535524:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+5:14203:x1874203935595008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380496.535537:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380496.535551:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff3200/0x651a07d118843443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884343c expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.535576:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff3200/0x651a07d118843443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884343c expref: 6 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.535586:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff3200/0x651a07d118843443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884343c expref: 6 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.535597:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3200, rc 0) 00000100:00100000:2.0:1787380496.535632:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+6:14203:x1874203935595008:12345-0@lo:101:mount.lustre.0 Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.535648:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380496.535950:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380496.535963:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.535972:0:14203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380496.536019:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380496.536046:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.536073:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd0fa600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380496.536188:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935595136 00000100:00100000:0.0:1787380496.536193:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935595136 00000100:00100000:0.0:1787380496.536227:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380496.536236:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+6:14203:x1874203935595136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380496.536872:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+6:14203:x1874203935595136:12345-0@lo:501:mount.lustre.0 Request processed in 635us (822us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380496.536880:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380496.539451:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595136:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787380496.539627:0:14203:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787380496.539657:0:14203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.539669:0:14203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380496.539677:0:14203:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d96bcdf7800 10000000:01000000:0.0:1787380496.539685:0:14203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787380496.539690:0:14203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d96bcdf7800 10000000:01000000:0.0:1787380496.539692:0:14203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787380496.539710:0:14203:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d96bcdf7800 from 1 10000000:01000000:0.0:1787380496.539713:0:14203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787380496.539881:0:14203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f000/0x651a07d11884344a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.539890:0:14203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f000/0x651a07d11884344a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.539901:0:14203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f000/0x651a07d11884344a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.539921:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787380496.539982:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.540021:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380496.540100:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935595264 00000100:00100000:3.0:1787380496.540107:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935595264 00000100:00100000:3.0:1787380496.540157:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380496.540330:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+6:14203:x1874203935595264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380496.540375:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380496.540391:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216ca00/0x651a07d118843451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884344a expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.540751:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216ca00/0x651a07d118843451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884344a expref: 7 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.540764:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216ca00/0x651a07d118843451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884344a expref: 7 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.540772:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ca00, rc 0) 00000100:00100000:3.0:1787380496.540825:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+7:14203:x1874203935595264:12345-0@lo:101:mount.lustre.0 Request processed in 660us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380496.540832:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380496.540922:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380496.540935:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f000/0x651a07d11884344a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843451 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.540944:0:14203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f000/0x651a07d11884344a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843451 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380496.540958:0:14203:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787380496.541008:0:14203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f000/0x651a07d11884344a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843451 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.541017:0:14203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f000/0x651a07d11884344a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843451 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380496.541023:0:14203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787380496.541035:0:14203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787380496.541040:0:14203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d96bcdf7800 10000000:01000000:0.0:1787380496.541042:0:14203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787380496.541045:0:14203:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787380496.541047:0:14203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787380496.541066:0:14203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e800/0x651a07d118843458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.541074:0:14203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e800/0x651a07d118843458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.541081:0:14203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e800/0x651a07d118843458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.541106:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787380496.541135:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.541180:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380496.541465:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935595392 00000100:00100000:1.0:1787380496.541471:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935595392 00000100:00100000:1.0:1787380496.541502:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380496.541510:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+7:14203:x1874203935595392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380496.541519:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380496.541535:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515e400/0x651a07d11884345f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843458 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.541549:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515e400/0x651a07d11884345f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843458 expref: 8 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.541558:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515e400/0x651a07d11884345f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843458 expref: 8 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.541565:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e400, rc 0) 00000100:00100000:1.0:1787380496.541601:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+8:14203:x1874203935595392:12345-0@lo:101:mount.lustre.0 Request processed in 91us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380496.541606:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380496.541884:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380496.541895:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e800/0x651a07d118843458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884345f expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.541903:0:14203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e800/0x651a07d118843458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884345f expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.541954:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380496.541981:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.542009:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380496.542065:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935595520 00000100:00100000:3.0:1787380496.542069:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935595520 00000100:00100000:3.0:1787380496.542109:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380496.542117:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+8:14203:x1874203935595520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380496.543021:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14203:x1874203935595520:12345-0@lo:501:mount.lustre.0 Request processed in 902us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380496.543030:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380496.544788:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380496.544860:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380496.544924:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.544969:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380496.545525:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935595648 00000100:00100000:3.0:1787380496.545533:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935595648 00000100:00100000:3.0:1787380496.545583:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380496.545591:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14203:x1874203935595648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380496.546003:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14203:x1874203935595648:12345-0@lo:503:mount.lustre.0 Request processed in 411us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380496.546011:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380496.550323:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935595648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380496.554758:0:14239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14239:1874203935595776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380496.554842:0:14239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.554928:0:14239:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380496.554975:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935595776 00000100:00100000:1.0:1787380496.554983:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935595776 00000100:00100000:1.0:1787380496.555475:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380496.555486:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14239:x1874203935595776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380496.555807:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14239:x1874203935595776:12345-0@lo:502:llog_process_th.0 Request processed in 323us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380496.555815:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380496.555899:0:14239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14239:1874203935595776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787380496.555926:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380496.555936:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.555938:0:14239:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787380496.555944:0:14239:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787380496.555947:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787380496.555960:0:14239:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d9695a5b380) 00000020:00000080:0.0:1787380496.555975:0:14239:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787380496.555979:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787380496.556053:0:14239:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787380496.556059:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d11884346d 00000020:00000080:0.0:1787380496.556262:0:14239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787380496.556267:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380496.556271:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.556272:0:14239:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787380496.556275:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380496.556278:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.556279:0:14239:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787380496.556283:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787380496.556290:0:14239:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d9695a5cd40) 00000020:00000080:0.0:1787380496.556299:0:14239:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787380496.556302:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787380496.556304:0:14239:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787380496.556313:0:14239:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787380496.556320:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787380496.556387:0:14239:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96bcdf7800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787380496.556399:0:14239:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d9695a58000) 00000020:00000080:0.0:1787380496.556407:0:14239:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787380496.556457:0:14239:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787380496.556463:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d118843482 00000020:00000080:0.0:1787380496.556564:0:14239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787380496.556570:0:14239:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787380496.556574:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x651a07d118843489 00080000:01000000:0.0:1787380496.556579:0:14239:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787380496.556582:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d118843490 00010000:00010000:3.0:1787380496.680136:0:14239:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787380496.680558:0:14239:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1787380496.680757:0:14239:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787380496.685784:0:14239:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d96bd423380) 00000020:00000080:3.0:1787380496.685808:0:14239:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787380496.686586:0:14239:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787380496.686601:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d11884349e 00000020:00000080:0.0:1787380496.691760:0:14239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787380496.712227:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x651a07d1188434a5 00000020:00000080:2.0:1787380496.715026:0:14239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787380496.715038:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380496.715126:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.715129:0:14239:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787380496.715135:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787380496.715138:0:14239:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787380496.715139:0:14239:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380496.715141:0:14239:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380496.715142:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787380496.715147:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.715149:0:14239:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787380496.715151:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380496.715156:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.715157:0:14239:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787380496.715162:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787380496.715207:0:14239:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787380496.715221:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380496.715225:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.715226:0:14239:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787380496.715229:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380496.715232:0:14239:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787380496.715235:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.715236:0:14239:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787380496.715239:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787380496.715244:0:14239:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:3.0:1787380496.715269:0:14239:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787380496.715271:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380496.715285:0:14239:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d96bd424d40) 00000020:00000080:3.0:1787380496.715302:0:14239:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787380496.715319:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787380496.715418:0:14239:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787380496.715424:0:14239:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787380496.715430:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d1188434b3 00010000:00080000:3.0:1787380496.715515:0:14239:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d96aaf12000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:3.0:1787380496.715744:0:14239:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787380496.716115:0:14239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787380496.716156:0:14239:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787380496.717035:0:14239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380496.717107:0:14239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787380496.717173:0:14239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787380496.718687:0:14243:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787380496.718696:0:14243:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787380496.719535:0:14239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380496.719547:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787380496.719576:0:14239:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787380496.719595:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d1188434ba 00000100:00080000:3.0:1787380496.719605:0:14239:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380496.719611:0:14239:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d96aaf12000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1787380496.719655:0:14239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9585eaa300 x1874203935595904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380496.719673:0:14239:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787380496.719719:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380496.719723:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.719725:0:14239:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787380496.719728:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787380496.719731:0:14239:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787380496.719732:0:14239:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380496.719734:0:14239:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380496.719735:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787380496.719738:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.719739:0:14239:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787380496.719742:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380496.719745:0:14239:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787380496.719756:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.719757:0:14239:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787380496.719761:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787380496.719765:0:14239:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.114@tcp to nid 0x20000c0a8ce72 (192.168.206.114@tcp) 00000020:01000000:3.0:1787380496.719786:0:14239:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787380496.719788:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380496.719806:0:14239:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d96aaa419c0) 00000020:00000080:3.0:1787380496.719818:0:14239:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787380496.719823:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1787380496.719964:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935595904:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787380496.720013:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203935595904 offset 0 length 520: 4 00000004:00080000:3.0:1787380496.720116:0:14239:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787380496.720121:0:14239:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787380496.727550:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x651a07d1188434c8 00010000:00080000:3.0:1787380496.727603:0:14239:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d96bd214800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.114@tcp at head 00000100:00100000:1.0:1787380496.727984:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935596032:0@lo:400:kworker.0 00000100:00100000:1.0:1787380496.728052:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380496.728151:0:14239:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787380496.728333:0:14239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787380496.728670:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935596032 00000100:00100000:2.0:1787380496.728688:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935596032 00000100:00100000:2.0:1787380496.728735:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380496.728743:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+9:3300:x1874203935596032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380496.728800:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+9:3300:x1874203935596032:12345-0@lo:400:kworker.0 Request processed in 57us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.728807:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380496.728927:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935596032:0@lo:400:kworker.0 00000040:01000000:3.0:1787380496.730012:0:14239:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787380496.730862:0:14239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380496.730946:0:14239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787380496.731013:0:14239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787380496.735659:0:14245:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787380496.735666:0:14245:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787380496.736441:0:14239:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380496.736453:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787380496.736484:0:14239:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787380496.736501:0:14239:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d1188434cf 00000100:00080000:3.0:1787380496.736510:0:14239:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380496.736516:0:14239:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d96bd214800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1787380496.736549:0:14239:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9585ea9180 x1874203935596160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380496.736569:0:14239:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787380496.736627:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380496.736631:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.736633:0:14239:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787380496.736636:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380496.736649:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.736650:0:14239:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380496.736653:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380496.736655:0:14239:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787380496.736657:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380496.736659:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.736660:0:14239:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787380496.736662:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380496.736664:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.736666:0:14239:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380496.736669:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787380496.736698:0:14239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14239:1874203935596288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380496.736774:0:14239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380496.736813:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935596288 00000100:00100000:3.0:1787380496.736819:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935596288 00000100:00100000:3.0:1787380496.736986:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380496.736996:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14239:x1874203935596288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380496.737214:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14239:x1874203935596288:12345-0@lo:502:llog_process_th.0 Request processed in 218us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380496.737222:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380496.737271:0:14239:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968a0cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380496.737291:0:14239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14239:1874203935596288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380496.737314:0:14239:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380496.737318:0:14239:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380496.737320:0:14239:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380496.737323:0:14239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:2.0:1787380496.737581:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935596160:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787380496.737610:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203935596160 offset 0 length 520: 4 00000020:01000000:2.0:1787380496.737651:0:14203:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787380496.737668:0:14203:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787380496.737681:0:14203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e800/0x651a07d118843458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884345f expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.737692:0:14203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1e800/0x651a07d118843458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884345f expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380496.737699:0:14203:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d96bcdf7800 from 1 10000000:01000000:2.0:1787380496.737701:0:14203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380496.737726:0:14203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.737734:0:14203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.737743:0:14203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380496.737766:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380496.737791:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.737812:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f0d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380496.737930:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935596416 00000100:00100000:1.0:1787380496.737935:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935596416 00000100:00100000:1.0:1787380496.737974:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380496.737981:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+9:14203:x1874203935596416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380496.737991:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380496.738004:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188434d6 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.738024:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188434d6 expref: 10 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.738034:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188434d6 expref: 10 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.738043:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e600, rc 0) 00000100:00100000:1.0:1787380496.738071:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+10:14203:x1874203935596416:12345-0@lo:101:mount.lustre.0 Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380496.738077:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380496.739989:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380496.740013:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.740024:0:14203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380496.740689:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596544:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787380496.740754:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.740791:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f0d0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380496.740818:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935596544 00000100:00100000:2.0:1787380496.740823:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935596544 00000100:00100000:2.0:1787380496.742138:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380496.742156:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+10:14203:x1874203935596544:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787380496.742179:0:14216:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787380496.742185:0:14216:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787380496.742279:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+10:14203:x1874203935596544:12345-0@lo:256:mount.lustre.0 Request processed in 131us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.742286:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380496.743554:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596544:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787380496.744818:0:14203:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787380496.744919:0:14203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.744931:0:14203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380496.744941:0:14203:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96bcdf7800 from 1 10000000:01000000:0.0:1787380496.744943:0:14203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380496.744981:0:14203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.744989:0:14203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.745000:0:14203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.745036:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787380496.745097:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.745131:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380496.745373:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935596672 00000100:00100000:3.0:1787380496.745381:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935596672 00000100:00100000:3.0:1787380496.745432:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787380496.745441:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+10:14203:x1874203935596672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380496.745454:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380496.745467:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188434e4 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.745489:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188434e4 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.745499:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188434e4 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.745507:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216ce00, rc 0) 00000100:00100000:3.0:1787380496.745545:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14203:x1874203935596672:12345-0@lo:101:mount.lustre.0 Request processed in 104us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380496.745552:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380496.745808:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380496.745821:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.745830:0:14203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.745962:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380496.745992:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.746020:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787380496.746544:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935596800 00000100:00100000:2.0:1787380496.746551:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935596800 00000100:00100000:2.0:1787380496.746591:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380496.746599:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14203:x1874203935596800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380496.747149:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14203:x1874203935596800:12345-0@lo:501:mount.lustre.0 Request processed in 548us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.747158:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787380496.751229:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380496.751299:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380496.751412:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.751462:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd0fa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380496.751768:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935596928 00000100:00100000:2.0:1787380496.751776:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935596928 00000100:00100000:2.0:1787380496.751826:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380496.751835:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14203:x1874203935596928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380496.752030:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14203:x1874203935596928:12345-0@lo:503:mount.lustre.0 Request processed in 196us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.752039:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380496.752187:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935596928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380496.752924:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14247:1874203935597056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380496.752977:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.753013:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380496.753059:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597056 00000100:00100000:3.0:1787380496.753064:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597056 00000100:00100000:3.0:1787380496.753100:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380496.753109:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14247:x1874203935597056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380496.753327:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14247:x1874203935597056:12345-0@lo:502:llog_process_th.0 Request processed in 218us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380496.753334:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787380496.753652:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14247:1874203935597056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787380496.753677:0:14247:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380496.753686:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.753688:0:14247:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787380496.753695:0:14247:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96bcdf7800 00000020:00000080:0.0:1787380496.753697:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380496.753705:0:14247:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380496.753707:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.753708:0:14247:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787380496.753710:0:14247:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380496.753719:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.753720:0:14247:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787380496.753725:0:14247:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96bcdf7800 00000020:00000080:0.0:1787380496.753727:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380496.753785:0:14247:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380496.753788:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.753789:0:14247:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787380496.753792:0:14247:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380496.753794:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.753795:0:14247:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787380496.753798:0:14247:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d96bcdf7800 00000020:00000080:0.0:1787380496.753800:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787380496.753837:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14247:1874203935597184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380496.753954:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.753987:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380496.754045:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597184 00000100:00100000:1.0:1787380496.754050:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597184 00000100:00100000:1.0:1787380496.754085:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380496.754093:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14247:x1874203935597184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380496.754241:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14247:x1874203935597184:12345-0@lo:502:llog_process_th.0 Request processed in 148us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380496.754254:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787380496.754968:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14247:1874203935597184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787380496.754993:0:14247:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380496.754999:0:14247:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380496.755000:0:14247:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787380496.755005:0:14247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787380496.755160:0:14203:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787380496.755179:0:14203:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380496.755201:0:14203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.755211:0:14203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380496.755250:0:14203:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787380496.755253:0:14203:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d96bcdf7800 10000000:01000000:1.0:1787380496.755256:0:14203:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d96bcdf7800 10000000:01000000:1.0:1787380496.755259:0:14203:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380496.755265:0:14203:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d96bcdf7800 from 1 10000000:01000000:1.0:1787380496.755267:0:14203:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380496.755294:0:14203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515ee00/0x651a07d1188434f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.755302:0:14203:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96b515ee00/0x651a07d1188434f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.755312:0:14203:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96b515ee00/0x651a07d1188434f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380496.755327:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935597312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380496.755575:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.755607:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd0fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380496.755957:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597312 00000100:00100000:0.0:1787380496.755963:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597312 00000100:00100000:0.0:1787380496.756006:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380496.756015:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14203:x1874203935597312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380496.756029:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380496.756043:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1e200/0x651a07d1188434f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188434f2 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.756064:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1e200/0x651a07d1188434f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188434f2 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.756087:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1e200/0x651a07d1188434f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188434f2 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.756094:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e200, rc 0) 00000100:00100000:0.0:1787380496.756132:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14203:x1874203935597312:12345-0@lo:101:mount.lustre.0 Request processed in 119us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.756139:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787380496.756269:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935597312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380496.756281:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96b515ee00/0x651a07d1188434f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434f9 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.756295:0:14203:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96b515ee00/0x651a07d1188434f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188434f9 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380496.757629:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935597440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380496.757694:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.757731:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd0fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380496.760129:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597440 00000100:00100000:0.0:1787380496.760144:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597440 00000100:00100000:0.0:1787380496.760197:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380496.760207:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14203:x1874203935597440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380496.760541:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14203:x1874203935597440:12345-0@lo:501:mount.lustre.0 Request processed in 334us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.760549:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787380496.761892:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5116d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935597440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380496.761947:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935597568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380496.762003:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.762031:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a03dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380496.762050:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597568 00000100:00100000:2.0:1787380496.762055:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597568 00000100:00100000:2.0:1787380496.762091:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380496.762097:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14203:x1874203935597568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380496.762248:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14203:x1874203935597568:12345-0@lo:503:mount.lustre.0 Request processed in 150us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.762255:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380496.762294:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935597568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380496.762515:0:14249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14249:1874203935597696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380496.762547:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.762570:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597696 00000100:00100000:2.0:1787380496.762573:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597696 00000100:00100000:2.0:1787380496.762591:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380496.762596:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14249:x1874203935597696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380496.762756:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14249:x1874203935597696:12345-0@lo:502:llog_process_th.0 Request processed in 159us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.762762:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380496.762785:0:14249:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a03dd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380496.762795:0:14249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14249:1874203935597696:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787380496.762837:0:14249:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787380496.762850:0:14249:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d9687730000) 00000020:00000080:2.0:1787380496.762867:0:14249:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787380496.762990:0:14249:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96bcdf7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787380496.762994:0:14249:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d96bcdf7800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787380496.762996:0:14249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d96bcdf7800 4 00010000:00080000:2.0:1787380496.763026:0:14249:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d96b5e4c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.114@tcp at head 00010000:00010000:2.0:1787380496.764466:0:14249:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787380496.764551:0:14249:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787380496.764584:0:14249:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787380496.764594:0:14249:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x651a07d118843507 00000100:00080000:2.0:1787380496.764603:0:14249:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787380496.764609:0:14249:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d96b5e4c800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1787380496.768980:0:14249:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9698da4000 x1874203935597824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380496.769027:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935597824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787380496.769097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.769145:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597824 00000100:00100000:1.0:1787380496.769153:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597824 00000100:00080000:2.0:1787380496.769155:0:14249:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787380496.769193:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380496.769201:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874203935597824:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787380496.769256:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874203935597824:12345-0@lo:38:llog_process_th.0 Request processed in 55us (158us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787380496.769263:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380496.769312:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787380496.769322:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96b5e4c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787380496.769327:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787380496.769423:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935597824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787380496.776167:0:14249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14249:1874203935597952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380496.776251:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.776288:0:14249:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9691fe29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380496.776310:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935597952 00000100:00100000:2.0:1787380496.776318:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935597952 00000100:00100000:2.0:1787380496.776392:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787380496.776401:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14249:x1874203935597952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380496.776927:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14249:x1874203935597952:12345-0@lo:502:llog_process_th.0 Request processed in 526us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380496.776936:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787380496.776987:0:14249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c6627fe6-651b-4b45-bfed-0a36822f804a:14249:1874203935597952:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787380496.777012:0:14249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787380496.777086:0:14203:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787380496.777107:0:14203:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380496.777122:0:14203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515ee00/0x651a07d1188434f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434f9 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.777133:0:14203:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515ee00/0x651a07d1188434f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188434f9 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787380496.777174:0:14203:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787380496.777176:0:14203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380496.777181:0:14203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380496.777182:0:14203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380496.777183:0:14203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380496.777185:0:14203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380496.777186:0:14203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380496.777187:0:14203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380496.777189:0:14203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380496.777190:0:14203:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380496.777193:0:14203:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787380496.777195:0:14203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380496.777197:0:14203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380496.777198:0:14203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380496.777199:0:14203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380496.777200:0:14203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380496.777201:0:14203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380496.777202:0:14203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380496.777202:0:14203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380496.777203:0:14203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380496.777204:0:14203:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380496.777216:0:14203:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787380496.777225:0:14203:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935598080:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787380496.777252:0:14203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.777281:0:14203:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9691fe29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380496.780986:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598080 00000100:00100000:0.0:1787380496.780999:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598080 00000100:00100000:0.0:1787380496.781069:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787380496.781079:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14203:x1874203935598080:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787380496.781109:0:14215:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787380496.781122:0:14215:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787380496.861990:0:14215:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787380496.862010:0:14215:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787380496.862928:0:14237:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787380496.862936:0:14237:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787380496.862956:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.862974:0:14237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188434d6 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.862983:0:14237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.863023:0:14237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188434d6 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380496.863054:0:14237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188434d6 expref: 12 pid: 14215 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380496.863069:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14237:1874203935598208:0@lo:104: 00000100:00100000:2.0:1787380496.863135:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380496.863178:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9691fe2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380496.863256:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598208 00000100:00100000:0.0:1787380496.863264:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598208 00000100:00100000:0.0:1787380496.863306:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380496.863315:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14237:x1874203935598208:12345-0@lo:104: 00010000:00010000:0.0:1787380496.863328:0:14204:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863407:0:14204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380496.863414:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14237:x1874203935598208:12345-0@lo:104: Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.863421:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380496.863464:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14237:1874203935598208:0@lo:104: 00010000:00010000:0.0:1787380496.863481:0:14237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863496:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380496.863501:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863508:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3e00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380496.863511:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863519:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380496.863527:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380496.863533:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380496.863557:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863563:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380496.863581:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863597:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3e00/0x651a07d1188434d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188434dd expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863612:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380496.863613:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380496.863615:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380496.863652:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c6627fe6-651b-4b45-bfed-0a36822f804a:3301:1874203935598336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380496.863677:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.863744:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598336 00000100:00100000:0.0:1787380496.863748:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598336 00010000:00010000:0.0:1787380496.863764:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188434d6 expref: 13 pid: 14215 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.863784:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380496.863790:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+13:3301:x1874203935598336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380496.863799:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380496.863804:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188434d6 expref: 13 pid: 14215 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863814:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188434d6 expref: 13 pid: 14215 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863826:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96b515e600/0x651a07d1188434dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188434d6 expref: 13 pid: 14215 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863838:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863855:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787380496.863869:0:14206:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000933875s 00010000:00010000:0.0:1787380496.863872:0:14206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863879:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863886:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863892:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863897:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2a00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380496.863900:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863907:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863919:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863928:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380496.863954:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:3301:x1874203935598336:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.863961:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787380496.863986:0:14237:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.863993:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.864000:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2a00/0x651a07d11884350e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.864024:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c6627fe6-651b-4b45-bfed-0a36822f804a:3301:1874203935598336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380496.877038:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14203:x1874203935598080:12345-0@lo:253:mount.lustre.0 Request processed in 95951us (99776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380496.877052:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787380496.877144:0:14203:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14203:1874203935598080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787380496.877158:0:14203:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787380496.877162:0:14203:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380496.877164:0:14203:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380496.877165:0:14203:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380496.877166:0:14203:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380496.877167:0:14203:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380496.877168:0:14203:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380496.877170:0:14203:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380496.877172:0:14203:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380496.877174:0:14203:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380496.877175:0:14203:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787380496.877187:0:14203:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787380496.884787:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380496.884965:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787380496.885237:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380496.885404:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787380496.885672:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787380496.885816:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787380496.886701:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787380496.886874:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787380496.887131:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787380496.887369:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787380496.887624:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787380496.887787:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787380496.935234:0:14203:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787380496.936090:0:14203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787380496.936322:0:14260:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787380496.936326:0:14260:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787380496.936516:0:14261:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787380496.936595:0:14261:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380496.939296:0:14261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787380496.939376:0:14261:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787380496.939380:0:14261:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1787380496.942176:0:14203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787380496.942308:0:14203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787380496.943029:0:14203:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787380496.943038:0:14203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787380496.943188:0:14203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380496.944674:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787380496.945199:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787380496.945233:0:14203:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787380496.950257:0:14203:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787380496.959575:0:14203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787380497.024833:0:14203:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787380497.024879:0:14203:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd3081caf988 00100000:10000000:1.0:1787380497.024887:0:14203:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787380497.025731:0:14203:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787380497.025752:0:14203:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787380497.025767:0:14203:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787380497.025794:0:14203:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787380497.335580:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787380497.849994:0:14218:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787380497.850001:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d96bcdf7800 from 6 10000000:01000000:0.0:1787380497.850005:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787380497.850046:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380497.850058:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380497.850080:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380497.850105:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935598464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380497.850170:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380497.850218:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96b55d3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380497.851043:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598464 00000100:00100000:2.0:1787380497.851052:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598464 00000100:00100000:2.0:1787380497.851112:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380497.851130:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14218:x1874203935598464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380497.851146:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380497.851164:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843515 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380497.851187:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843515 expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380497.851197:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843515 expref: 12 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380497.851205:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2200, rc 0) 00000100:00100000:2.0:1787380497.851258:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935598464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380497.851265:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380497.851316:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935598464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380497.851331:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380497.851356:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380497.851416:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935598592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787380497.851452:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380497.851470:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f153a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380497.851483:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598592 00000100:00100000:2.0:1787380497.851486:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598592 00000100:00100000:2.0:1787380497.851506:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380497.851518:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935598592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787380497.851532:0:14215:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787380497.851547:0:14215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787380497.851550:0:14215:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787380497.851621:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935598592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380497.851628:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380497.851668:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935598592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787380497.851701:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380497.851708:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380497.851715:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380497.854045:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787380498.361651:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787380498.875701:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787380499.384185:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380500.407837:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380501.431831:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787380501.840747:0:14504:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787380502.264105:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380502.264111:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380502.264114:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380502.264117:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380502.264119:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787380502.264122:0:1362:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380502.264126:0:1362:0:(import.c:65:import_set_state_nolock()) ffff9d96b5e4c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380502.264137:0:1362:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d96b5e4c800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:3.0:1787380502.264156:0:1362:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9585eab480 x1874203935598848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787380502.264223:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935598720:0@lo:400:kworker.0 00000100:00100000:0.0:1787380502.264287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380502.264403:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598720 00000100:00100000:3.0:1787380502.264411:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598720 00000100:00100000:3.0:1787380502.264457:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380502.264466:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:3302:x1874203935598720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380502.264512:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:3302:x1874203935598720:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380502.264519:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787380502.264626:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935598720:0@lo:400:kworker.0 00000100:00100000:2.0:1787380502.264695:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935598848:0@lo:38:kworker.0 00000100:00100000:2.0:1787380502.264726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380502.264806:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598848 00000100:00100000:0.0:1787380502.264810:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598848 00000100:00100000:0.0:1787380502.264838:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380502.264843:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1874203935598848:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787380502.264863:0:14223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:0.0:1787380502.264895:0:14223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x651a07d118843523 00000004:00100000:0.0:1787380502.264910:0:14223:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787380502.265026:0:14223:0:(import.c:65:import_set_state_nolock()) ffff9d968729c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380502.265074:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1874203935598848:12345-0@lo:38:kworker.0 Request processed in 229us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380502.265081:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787380502.265265:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d9585eab480 x1874203935598848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787380502.265278:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787380502.265284:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787380502.265289:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380502.265291:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96b5e4c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380502.265296:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3298:1874203935598848:0@lo:38:kworker.0 00010000:00010000:2.0:1787380502.455677:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380503.482507:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380504.503614:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787380504.698251:0:14655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe9bd88ff0 00000020:00000080:2.0:1787380504.698265:0:14655:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787380504.698270:0:14655:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787380504.698277:0:14655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9bd8b280 20000000:00000080:2.0:1787380504.698283:0:14655:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d96aabe4800 uarg=0000000000000000 20000000:01000000:2.0:1787380504.698316:0:14655:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787380504.698331:0:14655:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787380504.698990:0:14655:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787380504.700037:0:14656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787380504.700201:0:14655:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787380504.710962:0:14655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787380504.710996:0:14655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380504.711015:0:14655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188434e4 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380504.711025:0:14655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380504.711068:0:14655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188434e4 expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380504.711083:0:14655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188434e4 expref: 11 pid: 14214 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380504.711097:0:14655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14655:1874203935598976:0@lo:104: 00000100:00100000:2.0:1787380504.711155:0:14655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380504.711256:0:14655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380504.711321:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935598976 00000100:00100000:1.0:1787380504.711329:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935598976 00000100:00100000:1.0:1787380504.713247:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380504.713261:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14655:x1874203935598976:12345-0@lo:104: 00010000:00010000:1.0:1787380504.713277:0:14205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380504.713954:0:14655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14655:1874203935598976:0@lo:104: 00010000:00010000:2.0:1787380504.713977:0:14655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380504.714096:0:14205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380504.714103:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14655:x1874203935598976:12345-0@lo:104: Request processed in 847us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380504.714110:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787380504.715023:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380504.715033:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715041:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:0.0:1787380504.715045:0:14209:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715054:0:14209:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380504.715061:0:14209:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380504.715080:0:14209:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787380504.715126:0:14209:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715133:0:14209:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380504.715161:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715169:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9688e1f800/0x651a07d1188434e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188434eb expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715186:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380504.715188:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380504.715190:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380504.715198:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380504.715211:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935599104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380504.715258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380504.715305:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935599104 00000100:00100000:0.0:1787380504.715310:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935599104 00010000:00010000:0.0:1787380504.715354:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188434e4 expref: 12 pid: 14214 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380504.715538:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380504.715547:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:3300:x1874203935599104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380504.715561:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380504.715566:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188434e4 expref: 12 pid: 14214 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715577:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188434e4 expref: 12 pid: 14214 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715610:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216ce00/0x651a07d1188434eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188434e4 expref: 12 pid: 14214 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715624:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715632:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715645:0:14206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715652:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715658:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715664:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715670:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3e00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380504.715673:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715681:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715700:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.715722:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380504.715819:0:14655:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380504.715828:0:14655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380504.715843:0:14655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff3e00/0x651a07d11884352a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380504.716747:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+11:3300:x1874203935599104:12345-0@lo:103:ldlm_bl.0 Request processed in 1196us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380504.716757:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380504.718026:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935599104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380505.528622:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380506.359431:0:3298:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380496/real 1787380496] req@ffff9d9585ea9180 x1874203935596160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380506.359472:0:3298:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d9585ea9180 x1874203935596160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380506.359484:0:3298:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380496/real 1787380496] req@ffff9d9585eaa300 x1874203935595904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380506.359495:0:3298:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d9585eaa300 x1874203935595904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787380506.359514:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96bd214800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787380506.359532:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787380506.359536:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935596160:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787380506.359542:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96aaf12000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787380506.359547:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787380506.359550:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935595904:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787380506.359682:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380506.359686:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787380506.359689:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d96aaf12000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380506.359694:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1787380506.359698:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787380506.359704:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d96aaf12000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1787380506.359722:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9587461c00 x1874203935599360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380506.359734:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380506.359737:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787380506.359739:0:36:0:(import.c:65:import_set_state_nolock()) ffff9d96bd214800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380506.359742:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1787380506.359744:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787380506.359747:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d96bd214800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1787380506.359758:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9587462300 x1874203935599488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787380506.359805:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380506.359860:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935599232:0@lo:400:kworker.0 00000100:00100000:0.0:1787380506.359920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380506.359966:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380506.359987:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935599616:0@lo:400:kworker.0 00000100:00100000:0.0:1787380506.360019:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380506.360056:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935599616 00000100:00100000:0.0:1787380506.360063:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935599616 00000100:00100000:0.0:1787380506.360097:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380506.360105:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935599616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380506.360164:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935599616:12345-0@lo:400:kworker.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380506.360171:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787380506.360206:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d9587461180 x1874203935599616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380506.360216:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935599616:0@lo:400:kworker.0 00000100:00100000:2.0:1787380506.360422:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935599232 00000100:00100000:2.0:1787380506.360428:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935599232 00000100:00100000:2.0:1787380506.360459:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380506.360466:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+11:3299:x1874203935599232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380506.360504:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+11:3299:x1874203935599232:12345-0@lo:400:kworker.0 Request processed in 39us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380506.360517:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380506.360545:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935599360:0@lo:8:kworker.0 00000400:00000100:2.0:1787380506.360565:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203935599360 offset 0 length 520: 4 00000100:00100000:2.0:1787380506.360581:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935599488:0@lo:8:kworker.0 00000400:00000100:2.0:1787380506.360607:0:3298:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203935599488 offset 0 length 520: 4 00000100:00100000:2.0:1787380506.360634:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935599232:0@lo:400:kworker.0 10000000:01000000:2.0:1787380506.423440:0:14218:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380506.423447:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96bcdf7800 from 10 10000000:01000000:2.0:1787380506.423452:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380506.423496:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380506.423507:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380506.423517:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380506.423541:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935599744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380506.423619:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380506.423662:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96933c8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380506.423801:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935599744 00000100:00100000:3.0:1787380506.423808:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935599744 00000100:00100000:3.0:1787380506.423853:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787380506.423863:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+11:14218:x1874203935599744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380506.423875:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380506.423888:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843531 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380506.423911:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843531 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380506.423922:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843531 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380506.423931:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96c216d000, rc 0) 00000100:00100000:3.0:1787380506.423978:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935599744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380506.423985:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380506.424137:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935599744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380506.424152:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380506.424161:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380506.424215:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935599872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380506.424242:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380506.424264:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96957a7600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380506.424419:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935599872 00000100:00100000:2.0:1787380506.424423:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935599872 00000100:00100000:2.0:1787380506.424458:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380506.424465:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935599872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380506.424705:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935599872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380506.424719:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380506.424753:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935599872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380506.424784:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935600000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380506.424820:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380506.424839:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96be201e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380506.424849:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600000 00000100:00100000:2.0:1787380506.424852:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600000 00000100:00100000:2.0:1787380506.424868:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380506.424874:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935600000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380506.424998:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14218:x1874203935600000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380506.425005:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380506.425050:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935600000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787380506.425621:0:14727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787380506.425663:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787380506.425686:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380506.425694:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380506.425703:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380506.552504:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380507.577553:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380508.088119:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1787380508.594075:0:14855:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787380508.594079:0:14855:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787380508.594177:0:14855:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d96bd215800 00000020:01000004:3.0:1787380508.594192:0:14855:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787380508.594204:0:14855:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787380508.594216:0:14855:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d96aaa44d40) 00000020:00000080:3.0:1787380508.594230:0:14855:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1787380508.603450:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787380508.612743:0:14855:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787380508.613280:0:14855:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787380508.614490:0:14855:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787380508.614742:0:14855:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787380508.615166:0:14855:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787380508.615669:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 695: rc = 0 00100000:10000000:3.0:1787380508.615771:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 695: rc = 0 00100000:10000000:3.0:1787380508.615953:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 695: rc = 0 00100000:10000000:3.0:1787380508.616588:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 525: rc = 0 00100000:10000000:3.0:1787380508.617147:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 525: rc = 0 00100000:10000000:3.0:1787380508.617496:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 525: rc = 0 00100000:10000000:3.0:1787380508.617761:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 525: rc = 0 00100000:10000000:3.0:1787380508.618232:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 525: rc = 0 00100000:10000000:3.0:1787380508.618564:0:14855:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 525: rc = 0 00000020:00000080:3.0:1787380508.619332:0:14855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787380508.619370:0:14855:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787380508.619380:0:14855:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x651a07d118843546 00000020:01000004:3.0:1787380508.619387:0:14855:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787380508.619407:0:14855:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.114@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787380508.619410:0:14855:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787380508.619415:0:14855:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787380508.619420:0:14855:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787380508.619436:0:14855:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d96aaa43380) 00000020:00000080:3.0:1787380508.619447:0:14855:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787380508.620766:0:14855:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380508.620975:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787380508.620981:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787380508.621725:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380508.621735:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787380508.634430:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787380508.634459:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787380508.642309:0:14855:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380508.642561:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787380508.642567:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787380508.643290:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787380508.643298:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787380508.704691:0:14855:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380508.704904:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787380508.704917:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787380508.707497:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787380508.707511:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787380508.708390:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787380508.708399:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787380508.712413:0:14855:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380508.712593:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787380508.712599:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787380508.714881:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787380508.714893:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787380508.752537:0:14855:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380508.752737:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787380508.752743:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787380508.754230:0:14855:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787380508.754242:0:14855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787380508.754891:0:14855:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787380508.754912:0:14855:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787380508.754919:0:14855:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787380508.771213:0:14855:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787380508.771254:0:14855:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.114@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787380508.771258:0:14855:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787380508.771260:0:14855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787380508.771262:0:14855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380508.771263:0:14855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380508.771264:0:14855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380508.771266:0:14855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380508.771268:0:14855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380508.771269:0:14855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380508.771271:0:14855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380508.771275:0:14855:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787380508.771277:0:14855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380508.771279:0:14855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787380508.771280:0:14855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380508.771281:0:14855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380508.771282:0:14855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380508.771283:0:14855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380508.771285:0:14855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380508.771286:0:14855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380508.771287:0:14855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380508.771314:0:14855:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787380508.771333:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787380508.771639:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.771727:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380508.771772:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600128 00000100:00100000:0.0:1787380508.771853:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600128 00000100:00100000:0.0:1787380508.771941:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787380508.771960:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14855:x1874203935600128:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787380508.771997:0:14214:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787380508.772001:0:14214:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787380508.772004:0:14214:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787380508.777319:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14855:x1874203935600128:12345-0@lo:253:mount.lustre.0 Request processed in 5362us (5674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380508.777333:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787380508.777475:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787380508.777496:0:14855:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787380508.777499:0:14855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380508.777501:0:14855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787380508.777502:0:14855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380508.777504:0:14855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380508.777505:0:14855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380508.777506:0:14855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380508.777508:0:14855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380508.777509:0:14855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380508.777511:0:14855:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787380508.777528:0:14855:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d96bd215800 from lustre-OST0000 10000000:01000000:2.0:1787380508.777551:0:14855:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787380508.777554:0:14855:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787380508.777560:0:14855:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d96990499c0 local copy 00010000:00010000:2.0:1787380508.777569:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380508.777843:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380508.777879:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.777955:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380508.778146:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600256 00000100:00100000:3.0:1787380508.778152:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600256 00000100:00100000:3.0:1787380508.778224:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787380508.778232:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14855:x1874203935600256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380508.778412:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14855:x1874203935600256:12345-0@lo:501:mount.lustre.0 Request processed in 180us (531us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380508.778419:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380508.778510:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600256:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787380508.778523:0:14855:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787380508.778683:0:14855:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787380508.778690:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.778699:0:14855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380508.778722:0:14855:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d96bd215800 10000000:01000000:2.0:1787380508.778734:0:14855:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787380508.778739:0:14855:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d96990499c0 10000000:01000000:2.0:1787380508.778742:0:14855:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787380508.778745:0:14855:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9d96990499c0 from 1 10000000:01000000:2.0:1787380508.778747:0:14855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787380508.778773:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2a00/0x651a07d118843554 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.778793:0:14855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2a00/0x651a07d118843554 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.778801:0:14855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2a00/0x651a07d118843554 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380508.778815:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380508.778844:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.779368:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380508.779511:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600384 00000100:00100000:1.0:1787380508.779517:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600384 00000100:00100000:1.0:1787380508.779547:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787380508.779555:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+12:14855:x1874203935600384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380508.779566:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380508.779591:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515ea00/0x651a07d11884355b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843554 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.779614:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515ea00/0x651a07d11884355b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843554 expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.779626:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515ea00/0x651a07d11884355b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843554 expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.779635:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515ea00, rc 0) 00000100:00100000:1.0:1787380508.779679:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+13:14855:x1874203935600384:12345-0@lo:101:mount.lustre.0 Request processed in 124us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.779686:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787380508.779762:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380508.779784:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2a00/0x651a07d118843554 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884355b expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.779793:0:14855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2a00/0x651a07d118843554 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884355b expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380508.779809:0:14855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787380508.779828:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2a00/0x651a07d118843554 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884355b expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.779835:0:14855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9698ff2a00/0x651a07d118843554 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884355b expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380508.779856:0:14855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787380508.779861:0:14855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380508.779865:0:14855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787380508.779868:0:14855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787380508.779885:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3600/0x651a07d118843562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.779892:0:14855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3600/0x651a07d118843562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.779898:0:14855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3600/0x651a07d118843562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380508.779911:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380508.779940:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.779980:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380508.780253:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600512 00000100:00100000:1.0:1787380508.780259:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600512 00000100:00100000:1.0:1787380508.780288:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787380508.780294:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+13:14855:x1874203935600512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380508.780304:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380508.780313:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515e800/0x651a07d118843569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843562 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.780327:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515e800/0x651a07d118843569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843562 expref: 14 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.780362:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515e800/0x651a07d118843569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843562 expref: 14 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.780371:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e800, rc 0) 00000100:00100000:1.0:1787380508.780416:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935600512:12345-0@lo:101:mount.lustre.0 Request processed in 121us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.780421:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787380508.780608:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380508.780619:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3600/0x651a07d118843562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843569 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.780627:0:14855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3600/0x651a07d118843562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843569 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380508.781767:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787380508.783601:0:14855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380508.783936:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787380508.784173:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787380508.784210:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787380508.784274:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787380508.784309:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787380508.784483:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787380508.784556:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787380508.784565:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787380508.784664:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380508.784725:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.784923:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd4570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380508.785193:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600640 00000100:00100000:0.0:1787380508.785201:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600640 00000100:00100000:0.0:1787380508.785302:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380508.785312:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935600640:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380508.785714:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935600640:12345-0@lo:501:mount.lustre.0 Request processed in 402us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380508.785722:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380508.785827:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380508.785868:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380508.785910:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.786400:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd4570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380508.786566:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600768 00000100:00100000:3.0:1787380508.786581:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600768 00000100:00100000:3.0:1787380508.786613:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787380508.786621:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935600768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380508.787279:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935600768:12345-0@lo:503:mount.lustre.0 Request processed in 654us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380508.787289:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380508.787511:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380508.788969:0:14855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380508.789226:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380508.789295:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.789514:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd4570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380508.789658:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935600896 00000100:00100000:0.0:1787380508.789665:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935600896 00000100:00100000:0.0:1787380508.789749:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787380508.789759:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935600896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380508.790281:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935600896:12345-0@lo:502:mount.lustre.0 Request processed in 522us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380508.790290:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380508.790494:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935600896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380508.790765:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787380508.790898:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787380508.790933:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787380508.791170:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787380508.791221:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787380508.791253:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787380508.791298:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787380508.791332:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787380508.791591:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787380508.791655:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787380508.791691:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787380508.791737:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787380508.791850:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380508.791912:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.791997:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd4570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380508.792192:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601024 00000100:00100000:1.0:1787380508.792199:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601024 00000100:00100000:1.0:1787380508.792282:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380508.792290:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935601024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380508.792542:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935601024:12345-0@lo:502:mount.lustre.0 Request processed in 252us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.792549:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787380508.792634:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380508.792702:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787380508.792712:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787380508.793765:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380508.793787:0:14869:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787380508.793794:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380508.793796:0:14869:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787380508.793801:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380508.793813:0:14869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d96aaa40000) 00000020:00000080:3.0:1787380508.793833:0:14869:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787380508.793840:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787380508.793894:0:14869:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96bd215800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787380508.793908:0:14869:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787380508.793918:0:14869:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x651a07d118843577 00010000:00010000:3.0:1787380508.799552:0:14869:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787380508.800216:0:14869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787380508.803912:0:14869:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787380508.805745:0:14869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787380508.805757:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380508.805764:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.805766:0:14869:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787380508.805772:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787380508.805775:0:14869:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787380508.805777:0:14869:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787380508.805778:0:14869:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787380508.805780:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787380508.805782:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.805783:0:14869:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787380508.805786:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380508.805788:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.805790:0:14869:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787380508.805792:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787380508.805794:0:14869:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787380508.805796:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380508.805806:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.805807:0:14869:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787380508.805810:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380508.805813:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.805814:0:14869:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787380508.805817:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787380508.805880:0:14869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380508.805884:0:14869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.805885:0:14869:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787380508.805889:0:14869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787380508.811215:0:14855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787380508.811483:0:14855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787380508.811504:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3600/0x651a07d118843562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843569 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380508.811518:0:14855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3600/0x651a07d118843562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843569 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380508.811526:0:14855:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96bd215800 from 1 10000000:01000000:3.0:1787380508.811529:0:14855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380508.811564:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380508.811584:0:14855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380508.811595:0:14855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380508.811618:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787380508.811683:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380508.812318:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380508.818021:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601152 00000100:00100000:2.0:1787380508.818035:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601152 00000100:00100000:2.0:1787380508.818095:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380508.818104:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+14:14855:x1874203935601152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380508.818119:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380508.818136:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884357e expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.818163:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884357e expref: 15 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.818173:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884357e expref: 15 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.818182:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2400, rc 0) 00000100:00100000:2.0:1787380508.818269:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601152:12345-0@lo:101:mount.lustre.0 Request processed in 166us (6585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380508.818277:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787380508.818591:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380508.818609:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.818618:0:14855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380508.819553:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787380508.820625:0:14855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380508.820876:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787380508.820923:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787380508.821628:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787380508.821641:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787380508.821720:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380508.821786:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.821864:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380508.822762:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601280 00000100:00100000:0.0:1787380508.822771:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601280 00000100:00100000:0.0:1787380508.822876:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787380508.822885:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380508.823293:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601280:12345-0@lo:501:mount.lustre.0 Request processed in 408us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380508.823302:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787380508.823400:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380508.823439:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601408:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380508.823481:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.823784:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380508.823851:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601408 00000100:00100000:2.0:1787380508.823863:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601408 00000100:00100000:2.0:1787380508.823886:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380508.823892:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601408:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380508.824059:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601408:12345-0@lo:503:mount.lustre.0 Request processed in 167us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380508.824066:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787380508.824213:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601408:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787380508.824810:0:14855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380508.824871:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380508.824917:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.824944:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380508.825196:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601536 00000100:00100000:2.0:1787380508.825201:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601536 00000100:00100000:2.0:1787380508.825291:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787380508.825300:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380508.825565:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601536:12345-0@lo:502:mount.lustre.0 Request processed in 266us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380508.825585:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380508.825884:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787380508.827178:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787380508.827511:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787380508.827587:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787380508.827629:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787380508.827664:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787380508.827709:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787380508.827756:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787380508.827793:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787380508.827837:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380508.827908:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.827947:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380508.828194:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601664 00000100:00100000:2.0:1787380508.828201:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601664 00000100:00100000:2.0:1787380508.828320:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787380508.828330:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380508.828637:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601664:12345-0@lo:502:mount.lustre.0 Request processed in 308us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380508.828645:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380508.828924:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787380508.829296:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787380508.829311:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787380508.831750:0:14873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380508.831763:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.831766:0:14873:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787380508.831774:0:14873:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96bd215800 00000020:00000080:0.0:1787380508.831777:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380508.831784:0:14873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380508.831786:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.831787:0:14873:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787380508.831789:0:14873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380508.831792:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.831793:0:14873:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787380508.831796:0:14873:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96bd215800 00000020:00000080:0.0:1787380508.831798:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380508.831892:0:14873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380508.831896:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.831905:0:14873:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787380508.831908:0:14873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380508.831911:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.831912:0:14873:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787380508.831915:0:14873:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d96bd215800 00000020:00000080:0.0:1787380508.831917:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380508.836300:0:14873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380508.836313:0:14873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380508.836315:0:14873:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787380508.836321:0:14873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787380508.836705:0:14855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787380508.836735:0:14855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380508.836757:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.836770:0:14855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380508.836817:0:14855:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787380508.836820:0:14855:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d96bd215800 10000000:01000000:1.0:1787380508.836823:0:14855:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d96bd215800 10000000:01000000:1.0:1787380508.836827:0:14855:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380508.836833:0:14855:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d96bd215800 from 1 10000000:01000000:1.0:1787380508.836836:0:14855:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380508.836871:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f800/0x651a07d11884358c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.836880:0:14855:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96b515f800/0x651a07d11884358c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.836890:0:14855:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96b515f800/0x651a07d11884358c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380508.836925:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380508.837020:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.837058:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380508.837425:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601792 00000100:00100000:1.0:1787380508.837433:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601792 00000100:00100000:1.0:1787380508.837471:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787380508.837479:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935601792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380508.837493:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380508.837507:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515f000/0x651a07d118843593 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d11884358c expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.837530:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515f000/0x651a07d118843593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d11884358c expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.837540:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515f000/0x651a07d118843593 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884358c expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.837549:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f000, rc 0) 00000100:00100000:1.0:1787380508.837605:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935601792:12345-0@lo:101:mount.lustre.0 Request processed in 126us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.837612:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787380508.837657:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380508.837671:0:14855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96b515f800/0x651a07d11884358c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843593 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.837680:0:14855:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96b515f800/0x651a07d11884358c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843593 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380508.839158:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787380508.839965:0:14855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380508.840206:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787380508.840249:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787380508.840283:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787380508.840332:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787380508.840388:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787380508.840437:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787380508.840474:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787380508.840510:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787380508.840561:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787380508.843759:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787380508.843837:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787380508.847214:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787380508.847320:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787380508.847404:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787380508.847458:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787380508.847501:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787380508.847536:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787380508.847594:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787380508.847626:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787380508.847650:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787380508.847684:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787380508.850668:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787380508.850792:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787380508.850869:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787380508.850909:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787380508.850945:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787380508.851010:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787380508.851050:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787380508.851134:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787380508.851150:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787380508.851256:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380508.851324:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.851871:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96897c73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380508.852397:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935601920 00000100:00100000:1.0:1787380508.852406:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935601920 00000100:00100000:1.0:1787380508.852454:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787380508.852463:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935601920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380508.854533:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935601920:12345-0@lo:501:mount.lustre.0 Request processed in 2063us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.854544:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787380508.855167:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935601920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380508.855231:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380508.855284:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.855315:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602048 00000100:00100000:2.0:1787380508.855321:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602048 00000100:00100000:2.0:1787380508.855375:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380508.855513:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935602048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380508.855678:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935602048:12345-0@lo:503:mount.lustre.0 Request processed in 167us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380508.855685:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380508.855727:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380508.855741:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602048:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380508.856768:0:14855:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380508.856833:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380508.856883:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.856902:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2d93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380508.858359:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602176 00000100:00100000:1.0:1787380508.858369:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602176 00000100:00100000:1.0:1787380508.858423:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787380508.858433:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935602176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380508.858679:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935602176:12345-0@lo:502:mount.lustre.0 Request processed in 246us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.858687:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787380508.859166:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380508.860676:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787380508.860761:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787380508.860795:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787380508.860840:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787380508.860873:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787380508.860917:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787380508.860951:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787380508.860998:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787380508.863151:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787380508.863213:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787380508.864476:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787380508.864891:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787380508.864938:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787380508.865176:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787380508.866558:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787380508.867149:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787380508.867200:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787380508.868325:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787380508.868486:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787380508.868531:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787380508.868601:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787380508.868640:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787380508.868676:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787380508.868741:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787380508.868781:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787380508.868814:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787380508.868865:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787380508.868900:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787380508.868934:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787380508.868984:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787380508.870695:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787380508.870777:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787380508.870810:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787380508.870898:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787380508.870939:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787380508.874555:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787380508.874686:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787380508.874722:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787380508.874794:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787380508.874831:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787380508.874881:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380508.874975:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.875717:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602304 00000100:00100000:1.0:1787380508.875725:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602304 00000100:00100000:1.0:1787380508.875779:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787380508.875788:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935602304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380508.877151:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935602304:12345-0@lo:502:mount.lustre.0 Request processed in 1358us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.877164:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380508.877636:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380508.877665:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380508.877791:0:14855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787380508.877807:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787380508.880864:0:14878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787380508.880880:0:14878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d96877319c0) 00000020:00000080:2.0:1787380508.880907:0:14878:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787380508.881434:0:14878:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96bd215800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787380508.881439:0:14878:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d96bd215800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787380508.881442:0:14878:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d96bd215800 3 00010000:00080000:2.0:1787380508.881470:0:14878:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d9585fcf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.114@tcp at head 00010000:00010000:2.0:1787380508.883280:0:14878:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787380508.888210:0:14878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787380508.888334:0:14878:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787380508.888364:0:14878:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x651a07d1188435a1 00000100:00080000:2.0:1787380508.888375:0:14878:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787380508.888874:0:14878:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d9585fcf000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:2.0:1787380508.888916:0:14878:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9698da5f80 x1874203935602432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380508.888957:0:14878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787380508.888990:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380508.888995:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787380508.888998:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380508.889001:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787380508.889052:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380508.889066:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935602560:0@lo:400:kworker.0 00000100:00100000:2.0:1787380508.890292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.890641:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602560 00000100:00100000:1.0:1787380508.890650:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602560 00000100:00100000:1.0:1787380508.890710:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380508.890720:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935602560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.890790:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935602560:12345-0@lo:400:kworker.0 Request processed in 71us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.890798:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380508.890901:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874203935602432:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787380508.890933:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380508.893532:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602432 00000100:00100000:3.0:1787380508.893547:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602432 00000100:00100000:3.0:1787380508.893595:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380508.893603:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3298:x1874203935602432:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787380508.893634:0:14223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:3.0:1787380508.893693:0:14223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x651a07d1188435a8 00000004:00100000:3.0:1787380508.893709:0:14223:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787380508.893741:0:14223:0:(import.c:65:import_set_state_nolock()) ffff9d95851fc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380508.893829:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1874203935602432:12345-0@lo:38:llog_process_th.0 Request processed in 225us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380508.893837:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787380508.893880:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d9698da5f80 x1874203935602432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380508.893891:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380508.893899:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787380508.893906:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787380508.893911:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380508.893914:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d9585fcf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380508.893921:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3298:1874203935602432:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787380508.894374:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d9698da4700 x1874203935602560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380508.894396:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935602560:0@lo:400:kworker.0 00000040:00080000:2.0:1787380508.894529:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787380508.895406:0:14855:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787380508.895437:0:14855:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787380508.895458:0:14855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f800/0x651a07d11884358c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843593 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.895471:0:14855:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515f800/0x651a07d11884358c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843593 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787380508.895522:0:14855:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787380508.895524:0:14855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380508.895526:0:14855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380508.895527:0:14855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380508.895528:0:14855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380508.895530:0:14855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380508.895531:0:14855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380508.895533:0:14855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380508.895534:0:14855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380508.895538:0:14855:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787380508.895540:0:14855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380508.895541:0:14855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380508.895542:0:14855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380508.895544:0:14855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380508.895545:0:14855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380508.895546:0:14855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380508.895547:0:14855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380508.895548:0:14855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380508.895549:0:14855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380508.895581:0:14855:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787380508.895600:0:14855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787380508.895666:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.895700:0:14855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96988daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380508.895887:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602688 00000100:00100000:3.0:1787380508.895894:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602688 00000100:00100000:3.0:1787380508.895929:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787380508.895937:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14855:x1874203935602688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787380508.895990:0:14216:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787380508.896002:0:14216:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787380508.936321:0:14216:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787380508.936478:0:14216:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787380508.943250:0:14237:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787380508.943261:0:14237:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787380508.943283:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380508.943301:0:14237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843515 expref: 16 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380508.943309:0:14237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380508.943376:0:14237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118843515 expref: 16 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380508.943390:0:14237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118843515 expref: 16 pid: 14214 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380508.943403:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14237:1874203935602816:0@lo:104: 00000100:00100000:0.0:1787380508.943463:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380508.943502:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9692393600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380508.943615:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602816 00000100:00100000:1.0:1787380508.943622:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602816 00000100:00100000:1.0:1787380508.943667:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380508.943676:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14237:x1874203935602816:12345-0@lo:104: 00010000:00010000:1.0:1787380508.943689:0:14204:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.943738:0:14204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380508.943744:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14237:x1874203935602816:12345-0@lo:104: Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.943751:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787380508.943771:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380508.943788:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.943796:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fa00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380508.943800:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.943809:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380508.943816:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380508.943822:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380508.943847:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.943867:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380508.943886:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.943894:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9688e1fa00/0x651a07d118843515 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d11884351c expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380508.943910:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380508.943912:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380508.943913:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380508.943934:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935602944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380508.944231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380508.944315:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935602944 00000100:00100000:2.0:1787380508.944320:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935602944 00010000:00010000:2.0:1787380508.944375:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118843515 expref: 17 pid: 14214 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380508.944401:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380508.944408:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:3299:x1874203935602944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380508.944418:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380508.944423:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118843515 expref: 17 pid: 14214 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944433:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118843515 expref: 17 pid: 14214 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944450:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944458:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787380508.944472:0:14208:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001211792s 00010000:00010000:2.0:1787380508.944476:0:14208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944484:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944491:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944498:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944511:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ec00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380508.944516:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944524:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944532:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380508.944541:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380508.944587:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:3299:x1874203935602944:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380508.944594:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380508.944643:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935602944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380508.944718:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2200/0x651a07d11884351c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118843515 expref: 16 pid: 14214 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380508.944741:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14237:1874203935602816:0@lo:104: 00010000:00010000:0.0:1787380508.944754:0:14237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380508.944762:0:14237:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380508.944768:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380508.944784:0:14237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1ec00/0x651a07d1188435af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380508.945235:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14855:x1874203935602688:12345-0@lo:253:mount.lustre.0 Request processed in 49296us (49566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380508.945245:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787380508.945302:0:14855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:14855:1874203935602688:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787380508.945312:0:14855:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787380508.945315:0:14855:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380508.945317:0:14855:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380508.945318:0:14855:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380508.945320:0:14855:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380508.945321:0:14855:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380508.945322:0:14855:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380508.945324:0:14855:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380508.945326:0:14855:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380508.945328:0:14855:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787380508.945485:0:14855:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787380508.952178:0:14855:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380508.952483:0:14855:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787380508.952653:0:14855:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380508.953136:0:14855:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787380508.953289:0:14855:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380508.954165:0:14855:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787380508.954917:0:14855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787380509.020503:0:14855:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787380509.020511:0:14855:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787380509.020540:0:14855:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787380509.020628:0:14855:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787380509.020643:0:14855:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787380509.020668:0:14855:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787380509.626658:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380510.397899:0:14218:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787380510.397907:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d96bcdf7800 from 7 10000000:01000000:3.0:1787380510.397912:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787380510.397960:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380510.397971:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380510.397981:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380510.398696:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935603072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380510.398779:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380510.398857:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96be201000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380510.400554:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603072 00000100:00100000:1.0:1787380510.400589:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603072 00000100:00100000:1.0:1787380510.400653:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787380510.400663:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+15:14218:x1874203935603072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380510.400679:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380510.400696:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188435b6 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380510.400721:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188435b6 expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380510.400732:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188435b6 expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380510.400740:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515ec00, rc 0) 00000100:00100000:1.0:1787380510.400812:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14218:x1874203935603072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380510.400819:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787380510.400878:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935603072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380510.400896:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380510.400906:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380510.400964:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935603200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787380510.400998:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380510.401041:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96be201000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380510.401066:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603200 00000100:00100000:2.0:1787380510.401071:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603200 00000100:00100000:2.0:1787380510.401106:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380510.401113:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14218:x1874203935603200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787380510.401127:0:14216:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787380510.401143:0:14216:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787380510.401146:0:14216:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787380510.401447:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14218:x1874203935603200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 333us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380510.401456:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787380510.401601:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935603200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787380510.401654:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787380510.401662:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380510.401670:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380510.649283:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380511.671731:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380512.698778:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380513.720176:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787380514.042735:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380514.042742:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380514.042745:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380514.042749:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787380514.042791:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935603328:0@lo:400:kworker.0 00000100:00100000:3.0:1787380514.042858:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380514.042913:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935603456:0@lo:400:kworker.0 00000100:00100000:3.0:1787380514.042940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380514.042957:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380514.042963:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935603584:0@lo:400:kworker.0 00000100:00100000:3.0:1787380514.042980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380514.043007:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603328 00000100:00100000:3.0:1787380514.043014:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603328 00000100:00100000:3.0:1787380514.043054:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787380514.043062:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:3300:x1874203935603328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380514.043734:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:3300:x1874203935603328:12345-0@lo:400:kworker.0 Request processed in 670us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380514.043757:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787380514.043791:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603456 00000100:00100000:3.0:1787380514.043796:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603456 00000100:00100000:3.0:1787380514.043832:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603584 00000100:00100000:3.0:1787380514.043835:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603584 00000100:00100000:3.0:1787380514.043867:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380514.043873:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935603456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380514.043914:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935603456:12345-0@lo:400:kworker.0 Request processed in 41us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380514.043920:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380514.043932:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380514.043938:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935603584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380514.043965:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935603584:12345-0@lo:400:kworker.0 Request processed in 28us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380514.043971:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380514.044009:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935603328:0@lo:400:kworker.0 00010000:00080000:3.0:1787380514.044039:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9585ea8380 x1874203935603584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380514.044049:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935603584:0@lo:400:kworker.0 00010000:00080000:3.0:1787380514.044058:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9585ea8e00 x1874203935603456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380514.044065:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935603456:0@lo:400:kworker.0 00000100:00080000:2.0:1787380514.047101:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787380514.660813:0:15224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787380514.744718:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380515.768390:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380516.791861:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380517.819123:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787380518.329282:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380518.843216:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380519.160658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380519.160665:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380519.160667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380519.160670:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380519.160750:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935603712:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.160817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.160865:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380519.160872:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935603840:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.160899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.160930:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935603968:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.161080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.161118:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603712 00000100:00100000:0.0:1787380519.161125:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603712 00000100:00100000:0.0:1787380519.161165:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787380519.161174:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:3299:x1874203935603712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.161222:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:3299:x1874203935603712:12345-0@lo:400:kworker.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.161229:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787380519.161260:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603840 00000100:00100000:0.0:1787380519.161263:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603840 00000100:00100000:0.0:1787380519.161285:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935603968 00000100:00100000:0.0:1787380519.161287:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935603968 00000100:00100000:0.0:1787380519.161309:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380519.161315:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935603840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.161367:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935603840:12345-0@lo:400:kworker.0 Request processed in 51us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.161373:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380519.161385:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380519.161390:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935603968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.161417:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874203935603968:12345-0@lo:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.161430:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787380519.161455:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787380519.161479:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9587460e00 x1874203935603968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380519.161492:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3301:1874203935603968:0@lo:400:kworker.0 00010000:00080000:0.0:1787380519.161536:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9587462d80 x1874203935603840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380519.161545:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935603840:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.161554:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935603712:0@lo:400:kworker.0 00010000:00010000:2.0:1787380519.867609:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787380520.097207:0:15525:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787380520.097211:0:15525:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787380520.097566:0:15525:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d96aaef6000 00000020:01000004:0.0:1787380520.097581:0:15525:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787380520.097593:0:15525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787380520.097606:0:15525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d9695a599c0) 00000020:00000080:0.0:1787380520.097621:0:15525:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787380520.137578:0:15525:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787380520.139551:0:15525:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787380520.140753:0:15525:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787380520.141160:0:15525:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787380520.141534:0:15525:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787380520.142397:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:2.0:1787380520.142499:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 523: rc = 0 00100000:10000000:2.0:1787380520.142617:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 523: rc = 0 00100000:10000000:2.0:1787380520.146057:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 470: rc = 0 00100000:10000000:2.0:1787380520.146535:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 470: rc = 0 00100000:10000000:2.0:1787380520.147130:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 470: rc = 0 00100000:10000000:2.0:1787380520.147465:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 470: rc = 0 00100000:10000000:2.0:1787380520.149391:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 470: rc = 0 00100000:10000000:2.0:1787380520.149686:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 470: rc = 0 00000020:00000080:2.0:1787380520.150206:0:15525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787380520.150216:0:15525:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787380520.150226:0:15525:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x651a07d1188435cb 00000020:01000004:2.0:1787380520.150234:0:15525:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787380520.150253:0:15525:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.114@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787380520.150256:0:15525:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.114@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787380520.150268:0:15525:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787380520.150288:0:15525:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787380520.150292:0:15525:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.114@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787380520.160733:0:15525:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.114@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787380520.160776:0:15525:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.114@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787380520.160784:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787380520.160786:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787380520.160787:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380520.160788:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380520.160789:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380520.160790:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380520.160791:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380520.160792:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380520.160794:0:15525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787380520.160797:0:15525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787380520.160799:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787380520.160800:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787380520.160801:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380520.160802:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380520.160803:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380520.160804:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380520.160804:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380520.160806:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380520.160806:0:15525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787380520.160831:0:15525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787380520.160910:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604096:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787380520.161054:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.161149:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689779e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380520.161234:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604096 00000100:00100000:2.0:1787380520.161241:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604096 00000100:00100000:2.0:1787380520.161322:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380520.161331:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+16:15525:x1874203935604096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787380520.161377:0:14216:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787380520.161380:0:14216:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787380520.161383:0:14216:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787380520.171309:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+16:15525:x1874203935604096:12345-0@lo:253:mount.lustre.0 Request processed in 9971us (10247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380520.171323:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380520.171480:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604096:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787380520.171493:0:15525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787380520.171497:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380520.171499:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787380520.171500:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380520.171501:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380520.171502:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380520.171504:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380520.171505:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380520.171507:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380520.171520:0:15525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787380520.171613:0:15525:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d96aaef6000 from lustre-OST0001 10000000:01000000:3.0:1787380520.171640:0:15525:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787380520.171642:0:15525:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787380520.171650:0:15525:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d96990499c0 local copy 00010000:00010000:3.0:1787380520.171660:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380520.172202:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380520.172248:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.172327:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689779840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380520.172450:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604224 00000100:00100000:0.0:1787380520.172456:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604224 00000100:00100000:0.0:1787380520.172548:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380520.172558:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:15525:x1874203935604224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380520.172729:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+16:15525:x1874203935604224:12345-0@lo:501:mount.lustre.0 Request processed in 172us (479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380520.172737:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787380520.172809:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787380520.172823:0:15525:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.114@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787380520.173241:0:15525:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.114@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787380520.173250:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380520.173260:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515f600/0x651a07d11884343c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843443 expref: -99 pid: 14203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380520.173282:0:15525:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d96aaef6000 10000000:01000000:3.0:1787380520.173287:0:15525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787380520.173293:0:15525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787380520.173295:0:15525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787380520.173300:0:15525:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787380520.173302:0:15525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787380520.173326:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d1188435d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380520.173334:0:15525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d1188435d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380520.173369:0:15525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d1188435d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380520.173386:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787380520.173418:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.173604:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689779840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.175065:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604352 00000100:00100000:1.0:1787380520.175077:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604352 00000100:00100000:1.0:1787380520.175127:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787380520.175136:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:15525:x1874203935604352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380520.175150:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380520.175165:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515fa00/0x651a07d1188435d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188435d2 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.175188:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515fa00/0x651a07d1188435d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188435d2 expref: 17 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.175213:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515fa00/0x651a07d1188435d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188435d2 expref: 17 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.175221:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fa00, rc 0) 00000100:00100000:1.0:1787380520.175291:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604352:12345-0@lo:101:mount.lustre.0 Request processed in 155us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.175297:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787380520.175613:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380520.175631:0:15525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d1188435d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435d9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380520.175640:0:15525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d1188435d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188435d9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380520.176685:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787380520.178263:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380520.178693:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787380520.178814:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787380520.178843:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787380520.178889:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787380520.178925:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787380520.179027:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787380520.179088:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787380520.179095:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787380520.179179:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380520.179241:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.179375:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9689779b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.185261:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604480 00000100:00100000:1.0:1787380520.185276:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604480 00000100:00100000:1.0:1787380520.185363:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787380520.185373:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380520.186026:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604480:12345-0@lo:501:mount.lustre.0 Request processed in 653us (6783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.186036:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787380520.186321:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380520.186460:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380520.186524:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380520.186601:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380520.186832:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604608 00000100:00100000:0.0:1787380520.186838:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604608 00000100:00100000:0.0:1787380520.186913:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787380520.186943:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380520.187266:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604608:12345-0@lo:503:mount.lustre.0 Request processed in 326us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380520.187274:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787380520.187379:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380520.188142:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380520.188230:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380520.188283:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380520.190426:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380520.190572:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604736 00000100:00100000:3.0:1787380520.190582:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604736 00000100:00100000:3.0:1787380520.190630:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787380520.190639:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380520.191158:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604736:12345-0@lo:502:mount.lustre.0 Request processed in 517us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380520.191179:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787380520.191292:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787380520.191824:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787380520.191959:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787380520.191996:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787380520.192047:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787380520.192084:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787380520.192119:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787380520.192167:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787380520.192203:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787380520.192249:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787380520.192287:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380520.194226:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.194401:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aae0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380520.194473:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604864 00000100:00100000:0.0:1787380520.194481:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604864 00000100:00100000:0.0:1787380520.194583:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787380520.194593:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380520.195161:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604864:12345-0@lo:502:mount.lustre.0 Request processed in 567us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380520.195170:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787380520.195313:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787380520.195432:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787380520.195446:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787380520.196708:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380520.196782:0:15526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787380520.196788:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.196790:0:15526:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787380520.196797:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380520.196828:0:15526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d9586bf4d40) 00000020:00000080:3.0:1787380520.196922:0:15526:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787380520.196933:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787380520.196989:0:15526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96aaef6000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787380520.196997:0:15526:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787380520.197003:0:15526:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x651a07d1188435e7 00010000:00010000:3.0:1787380520.203157:0:15526:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787380520.203937:0:15526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787380520.206055:0:15526:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787380520.207709:0:15526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787380520.207734:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380520.207742:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.207752:0:15526:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787380520.207756:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380520.207760:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.207762:0:15526:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380520.207764:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380520.207767:0:15526:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787380520.207769:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380520.207771:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.207772:0:15526:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787380520.207774:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380520.207776:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.207777:0:15526:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380520.207780:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787380520.207835:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380520.207838:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.207839:0:15526:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380520.207842:0:15526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787380520.213949:0:15525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787380520.213990:0:15525:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787380520.214013:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d1188435d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435d9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.214024:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96c216ce00/0x651a07d1188435d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435d9 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380520.214032:0:15525:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96aaef6000 from 1 10000000:01000000:2.0:1787380520.214034:0:15525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380520.214071:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.214079:0:15525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.214088:0:15525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380520.214112:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380520.214171:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380520.214202:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.214389:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935604992 00000100:00100000:1.0:1787380520.214397:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935604992 00000100:00100000:1.0:1787380520.214440:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787380520.214448:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+17:15525:x1874203935604992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380520.214459:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380520.214470:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188435ee expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.214489:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188435ee expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.214527:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188435ee expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.214535:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f200, rc 0) 00000100:00100000:1.0:1787380520.214576:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935604992:12345-0@lo:101:mount.lustre.0 Request processed in 128us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.214582:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787380520.214789:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935604992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380520.214804:0:15525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.214812:0:15525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380520.216503:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787380520.217168:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380520.220641:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787380520.221571:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787380520.221692:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787380520.221701:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787380520.221873:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380520.221939:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380520.221985:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.223077:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935605120 00000100:00100000:1.0:1787380520.223087:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935605120 00000100:00100000:1.0:1787380520.223142:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787380520.223150:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380520.223424:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605120:12345-0@lo:501:mount.lustre.0 Request processed in 273us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.223432:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787380520.226433:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380520.226488:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380520.226569:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380520.226598:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.226662:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935605248 00000100:00100000:1.0:1787380520.226668:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935605248 00000100:00100000:1.0:1787380520.226727:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787380520.226735:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380520.226922:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605248:12345-0@lo:503:mount.lustre.0 Request processed in 187us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.226930:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380520.227158:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605248:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380520.227866:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380520.227936:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380520.227986:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380520.228010:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.228729:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935605376 00000100:00100000:1.0:1787380520.228737:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935605376 00000100:00100000:1.0:1787380520.228783:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787380520.228793:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380520.229008:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605376:12345-0@lo:502:mount.lustre.0 Request processed in 216us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.229022:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380520.229252:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380520.229535:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787380520.229586:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787380520.230384:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787380520.230439:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787380520.230467:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787380520.230506:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787380520.230568:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787380520.230603:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787380520.230644:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605504:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380520.235037:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380520.235136:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96893b9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.235184:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935605504 00000100:00100000:1.0:1787380520.235191:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935605504 00000100:00100000:1.0:1787380520.235263:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787380520.235280:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380520.235542:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605504:12345-0@lo:502:mount.lustre.0 Request processed in 270us (4826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.235549:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787380520.235646:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787380520.235814:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787380520.235829:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787380520.236907:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380520.236918:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.236920:0:15530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787380520.236927:0:15530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96aaef6000 00000020:00000080:3.0:1787380520.236930:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380520.236936:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380520.236938:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.236940:0:15530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787380520.236942:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380520.236943:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.236944:0:15530:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787380520.236947:0:15530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d96aaef6000 00000020:00000080:3.0:1787380520.236949:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380520.237005:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380520.240487:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.240495:0:15530:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787380520.240525:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380520.240532:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.240534:0:15530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787380520.240539:0:15530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d96aaef6000 00000020:00000080:3.0:1787380520.240542:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380520.246264:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380520.246561:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380520.246563:0:15530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787380520.246570:0:15530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787380520.256836:0:15525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787380520.256876:0:15525:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380520.256897:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.256909:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380520.256954:0:15525:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787380520.256957:0:15525:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d96aaef6000 10000000:01000000:1.0:1787380520.256960:0:15525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d96aaef6000 10000000:01000000:1.0:1787380520.256964:0:15525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380520.256969:0:15525:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d96aaef6000 from 1 10000000:01000000:1.0:1787380520.256972:0:15525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380520.257003:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515fc00/0x651a07d1188435fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.257010:0:15525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96b515fc00/0x651a07d1188435fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.257019:0:15525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96b515fc00/0x651a07d1188435fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380520.257047:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380520.257102:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380520.257139:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96811c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380520.257436:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935605632 00000100:00100000:0.0:1787380520.257444:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935605632 00000100:00100000:0.0:1787380520.257492:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787380520.257500:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935605632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380520.257524:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380520.257539:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9688e1f200/0x651a07d118843603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188435fc expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380520.257562:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1f200/0x651a07d118843603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188435fc expref: 19 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380520.257572:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9688e1f200/0x651a07d118843603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188435fc expref: 19 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380520.257580:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1f200, rc 0) 00000100:00100000:0.0:1787380520.257621:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935605632:12345-0@lo:101:mount.lustre.0 Request processed in 121us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380520.257638:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787380520.258869:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380520.258889:0:15525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96b515fc00/0x651a07d1188435fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843603 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.258901:0:15525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96b515fc00/0x651a07d1188435fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843603 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380520.259445:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787380520.262225:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380520.262545:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787380520.262593:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787380520.262624:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787380520.262667:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787380520.262702:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787380520.264492:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787380520.264553:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787380520.264585:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787380520.264623:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787380520.264650:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787380520.264675:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787380520.264840:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787380520.264876:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787380520.264901:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787380520.264938:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787380520.264964:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787380520.264989:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787380520.265039:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787380520.265066:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787380520.265092:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787380520.265128:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787380520.265167:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787380520.265194:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787380520.265230:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787380520.265256:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787380520.265281:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787380520.265315:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787380520.268628:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787380520.269264:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787380520.269409:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787380520.269450:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787380520.269480:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787380520.270431:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787380520.275299:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787380520.275410:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787380520.275476:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787380520.276042:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787380520.276170:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787380520.276180:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787380520.276272:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380520.276334:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380520.276391:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96811c8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380520.276399:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935605760 00000100:00100000:3.0:1787380520.276406:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935605760 00000100:00100000:3.0:1787380520.276452:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380520.276461:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935605760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380520.276706:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935605760:12345-0@lo:501:mount.lustre.0 Request processed in 246us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380520.276723:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380520.276763:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380520.276792:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380520.276828:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.276840:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9688e5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.277760:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935605888 00000100:00100000:1.0:1787380520.277768:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935605888 00000100:00100000:1.0:1787380520.277810:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787380520.277818:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95862d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935605888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380520.278075:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95862d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935605888:12345-0@lo:503:mount.lustre.0 Request processed in 257us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.278092:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787380520.278761:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eaa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935605888:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787380520.280230:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380520.280306:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935606016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380520.280390:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380520.280424:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96913dab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380520.283467:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606016 00000100:00100000:0.0:1787380520.283482:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606016 00000100:00100000:0.0:1787380520.283558:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787380520.283567:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935606016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380520.283959:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935606016:12345-0@lo:502:mount.lustre.0 Request processed in 392us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380520.283968:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787380520.284034:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935606016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380520.284291:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787380520.284363:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787380520.284402:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787380520.284445:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787380520.284481:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787380520.285033:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787380520.285076:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787380520.285109:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787380520.285153:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787380520.285185:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787380520.285211:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787380520.285245:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787380520.285331:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787380520.285387:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787380520.285448:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787380520.285476:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787380520.285501:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787380520.285638:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787380520.285674:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787380520.285708:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787380520.285962:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787380520.286000:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787380520.286031:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787380520.286080:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787380520.286136:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787380520.286174:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787380520.286221:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787380520.286257:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787380520.286622:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787380520.286679:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787380520.286817:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787380520.286855:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787380520.286892:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787380520.286942:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787380520.286979:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787380520.287026:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787380520.287061:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787380520.287096:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787380520.287144:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787380520.287180:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787380520.287225:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935606144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380520.287487:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380520.287603:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ae8c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380520.287706:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606144 00000100:00100000:1.0:1787380520.287714:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606144 00000100:00100000:1.0:1787380520.287765:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787380520.287774:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935606144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380520.288310:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935606144:12345-0@lo:502:mount.lustre.0 Request processed in 535us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380520.288319:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787380520.288747:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935606144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380520.288853:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787380520.288867:0:15525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787380520.293233:0:15535:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787380520.293250:0:15535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d96be430000) 00000020:00000080:0.0:1787380520.293270:0:15535:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787380520.294630:0:15535:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d96aaef6000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787380520.294716:0:15535:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d96aaef6000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787380520.294720:0:15535:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d96aaef6000 3 00010000:00080000:1.0:1787380520.294754:0:15535:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d95866a4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.114@tcp at head 00010000:00010000:0.0:1787380520.297547:0:15535:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787380520.297652:0:15535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787380520.301079:0:15535:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380520.301099:0:15535:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x651a07d118843611 00000100:00080000:0.0:1787380520.301111:0:15535:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380520.301117:0:15535:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d95866a4000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:0.0:1787380520.301154:0:15535:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d9587461180 x1874203935606272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380520.301183:0:15535:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787380520.301278:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380520.301284:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380520.301287:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380520.301290:0:1362:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380520.302061:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935606400:0@lo:400:kworker.0 00000100:00100000:0.0:1787380520.302123:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380520.302181:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935606528:0@lo:400:kworker.0 00000100:00100000:0.0:1787380520.302204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380520.302234:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606400 00000100:00100000:0.0:1787380520.302241:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606400 00000100:00100000:0.0:1787380520.302286:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606528 00000100:00100000:0.0:1787380520.302290:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606528 00000100:00100000:0.0:1787380520.302307:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380520.302313:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935606400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380520.302378:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935606400:12345-0@lo:400:kworker.0 Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380520.302384:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380520.302399:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380520.302404:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935606528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380520.302428:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935606528:12345-0@lo:400:kworker.0 Request processed in 24us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380520.302433:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787380520.302461:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5114a80 x1874203935606528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380520.302482:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935606528:0@lo:400:kworker.0 00010000:00080000:0.0:1787380520.302521:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d96b5117800 x1874203935606400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380520.302529:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935606400:0@lo:400:kworker.0 00000040:00080000:0.0:1787380520.302940:0:15535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787380520.302949:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874203935606272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787380520.302982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.303032:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606272 00000100:00100000:3.0:1787380520.303037:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606272 00000100:00100000:3.0:1787380520.303064:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380520.303069:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3298:x1874203935606272:12345-0@lo:38:llog_process_th.0 00000020:01000000:1.0:1787380520.303071:0:15525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00010000:00080000:3.0:1787380520.303095:0:14221:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 10000000:01000000:1.0:1787380520.303095:0:15525:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787380520.303109:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515fc00/0x651a07d1188435fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843603 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787380520.303123:0:14221:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x651a07d118843618 00010000:00010000:1.0:1787380520.303125:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515fc00/0x651a07d1188435fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843603 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:3.0:1787380520.303137:0:14221:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787380520.303163:0:14221:0:(import.c:65:import_set_state_nolock()) ffff9d9585fcd800 : changing import state from RECOVER to FULL 00000020:01000004:1.0:1787380520.303164:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787380520.303166:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787380520.303167:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380520.303168:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380520.303170:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380520.303171:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380520.303172:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380520.303174:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380520.303175:0:15525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380520.303178:0:15525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787380520.303180:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380520.303182:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787380520.303183:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380520.303184:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380520.303185:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380520.303186:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380520.303187:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380520.303188:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380520.303189:0:15525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1787380520.303198:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1874203935606272:12345-0@lo:38:llog_process_th.0 Request processed in 128us (215us total) trans 0 rc 0/0 10000000:01000000:1.0:1787380520.303203:0:15525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787380520.303204:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380520.303214:0:15525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935606656:0@lo:253:mount.lustre.0 00010000:00080000:3.0:1787380520.303233:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d9587461180 x1874203935606272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380520.303241:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1787380520.303246:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787380520.303247:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787380520.303253:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787380520.303257:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:1.0:1787380520.303259:0:15525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f153b40 going to sleep for 11 seconds 00000100:00080000:3.0:1787380520.303260:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d95866a4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380520.303265:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3298:1874203935606272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787380520.303466:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606656 00000100:00100000:2.0:1787380520.303471:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606656 00000100:00100000:2.0:1787380520.303523:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787380520.303531:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:15525:x1874203935606656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787380520.303551:0:14214:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787380520.303563:0:14214:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787380520.339852:0:14214:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787380520.339868:0:14214:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787380520.339926:0:14237:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787380520.339931:0:14237:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787380520.339951:0:14237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380520.339970:0:14237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188435b6 expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380520.339978:0:14237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380520.340017:0:14237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188435b6 expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380520.340030:0:14237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188435b6 expref: 19 pid: 14215 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380520.340044:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14237:1874203935606784:0@lo:104: 00000100:00100000:0.0:1787380520.340103:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380520.340181:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96bd457600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380520.341415:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606784 00000100:00100000:2.0:1787380520.341426:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606784 00000100:00100000:2.0:1787380520.342236:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380520.342248:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14237:x1874203935606784:12345-0@lo:104: 00010000:00010000:2.0:1787380520.342265:0:14205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.342403:0:14205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787380520.342410:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c6627fe6-651b-4b45-bfed-0a36822f804a+3:14237:x1874203935606784:12345-0@lo:104: Request processed in 166us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380520.342417:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787380520.348181:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380520.348195:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.348208:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:2.0:1787380520.348230:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.348241:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380520.348249:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380520.348255:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787380520.348466:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.348474:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380520.348500:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.348520:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216de00/0x651a07d1188435b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188435bd expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.348713:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380520.348715:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380520.348717:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380520.348739:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935606912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380520.348804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380520.348951:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14237:1874203935606784:0@lo:104: 00000100:00100000:2.0:1787380520.348956:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935606912 00000100:00100000:2.0:1787380520.348964:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935606912 00010000:00010000:3.0:1787380520.348979:0:14237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349020:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188435b6 expref: 20 pid: 14215 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380520.349067:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380520.349084:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+20:3300:x1874203935606912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380520.349097:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380520.349104:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188435b6 expref: 20 pid: 14215 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349117:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188435b6 expref: 20 pid: 14215 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349134:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96b515ec00/0x651a07d1188435bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188435b6 expref: 20 pid: 14215 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349149:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349158:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787380520.349173:0:14208:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009241999s 00010000:00010000:2.0:1787380520.349178:0:14208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349186:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349193:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349206:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349212:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380520.349224:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349232:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349257:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.349350:0:14237:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380520.349358:0:14237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349427:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9688e1f400/0x651a07d11884361f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380520.349442:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380520.349484:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3300:x1874203935606912:12345-0@lo:103:ldlm_bl.0 Request processed in 401us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380520.349492:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380520.349520:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935606912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380520.356993:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+18:15525:x1874203935606656:12345-0@lo:253:mount.lustre.0 Request processed in 53455us (53737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380520.357009:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787380520.359476:0:15525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c6627fe6-651b-4b45-bfed-0a36822f804a:15525:1874203935606656:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787380520.359527:0:15525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787380520.359531:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380520.359532:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787380520.359534:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380520.359535:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380520.359536:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380520.359537:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380520.359539:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380520.359541:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380520.359542:0:15525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787380520.359559:0:15525:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787380520.370377:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380520.370568:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787380520.370737:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380520.370902:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787380520.371053:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787380520.371258:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787380520.374139:0:15525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787380520.452074:0:15525:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787380520.452082:0:15525:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787380520.452124:0:15525:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787380520.452191:0:15525:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.114@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787380520.452204:0:15525:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787380520.452230:0:15525:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787380520.890964:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380521.335566:0:3298:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380506/real 1787380506] req@ffff9d9587461c00 x1874203935599360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380521.335592:0:3298:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d9587461c00 x1874203935599360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380521.335602:0:3298:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380506/real 1787380506] req@ffff9d9587462300 x1874203935599488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380521.335613:0:3298:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d9587462300 x1874203935599488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787380521.335630:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96aaf12000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787380521.335653:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787380521.335657:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935599360:0@lo:8:kworker.0 00000100:00080000:3.0:1787380521.335662:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96bd214800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787380521.335667:0:3298:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787380521.335669:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935599488:0@lo:8:kworker.0 00000100:00080000:1.0:1787380521.335770:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380521.335776:0:1362:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787380521.335779:0:1362:0:(import.c:65:import_set_state_nolock()) ffff9d96aaf12000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787380521.335786:0:1362:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1787380521.335791:0:1362:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787380521.335797:0:1362:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d96aaf12000 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1787380521.335819:0:1362:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d96b5117800 x1874203935607168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380521.335836:0:1362:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380521.335840:0:1362:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787380521.335842:0:1362:0:(import.c:65:import_set_state_nolock()) ffff9d96bd214800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787380521.335847:0:1362:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 456 00000100:00080000:1.0:1787380521.335850:0:1362:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787380521.335855:0:1362:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d96bd214800 using connection 192.168.206.114@tcp/0@lo 00000100:00100000:1.0:1787380521.335869:0:1362:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d96b5114a80 x1874203935607296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787380521.336068:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935607424:0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.336142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380521.336203:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380521.336212:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935607040:0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.336247:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380521.336304:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935607552:0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.336368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380521.336386:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380521.336391:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935607680:0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.336414:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380521.336465:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607424 00000100:00100000:1.0:1787380521.336473:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607424 00000100:00100000:1.0:1787380521.336585:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607552 00000100:00100000:1.0:1787380521.336589:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607552 00000100:00100000:1.0:1787380521.336627:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607680 00000100:00100000:1.0:1787380521.336630:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607680 00000100:00100000:1.0:1787380521.336650:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380521.336658:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935607424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.337037:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935607424:12345-0@lo:400:kworker.0 Request processed in 378us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380521.337047:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380521.337066:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380521.337074:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935607552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.337111:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935607552:12345-0@lo:400:kworker.0 Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380521.337118:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380521.337129:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380521.337135:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935607680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.337253:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935607680:12345-0@lo:400:kworker.0 Request processed in 36us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380521.337261:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380521.337283:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607040 00000100:00100000:1.0:1787380521.337287:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607040 00000100:00100000:1.0:1787380521.337313:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787380521.337319:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:3302:x1874203935607040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.337368:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:3302:x1874203935607040:12345-0@lo:400:kworker.0 Request processed in 49us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380521.337374:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787380521.337421:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5115880 x1874203935607680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787380521.337683:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380521.338475:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935607168:0@lo:8:kworker.0 00000100:00100000:2.0:1787380521.338538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380521.338629:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935607680:0@lo:400:kworker.0 00010000:00080000:1.0:1787380521.338656:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5117b80 x1874203935607552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380521.338669:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935607552:0@lo:400:kworker.0 00000100:00100000:1.0:1787380521.338708:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935607040:0@lo:400:kworker.0 00010000:00080000:1.0:1787380521.338720:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5117100 x1874203935607424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380521.338728:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935607424:0@lo:400:kworker.0 00000100:00100000:2.0:1787380521.339523:0:3298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935607296:0@lo:8:kworker.0 00000100:00100000:2.0:1787380521.339559:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380521.348530:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607168 00000100:00100000:1.0:1787380521.348544:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607168 00000100:00100000:1.0:1787380521.348597:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607296 00000100:00100000:1.0:1787380521.348600:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607296 00000100:00100000:1.0:1787380521.348622:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380521.348629:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874203935607168:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787380521.348659:0:14856:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1787380521.348687:0:14856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d118843626 00002000:00100000:1.0:1787380521.348701:0:14856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d95866a1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787380521.348705:0:14856:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787380521.348718:0:14856:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380521.348991:0:14856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787380521.349014:0:14856:0:(import.c:65:import_set_state_nolock()) ffff9d95866a2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380521.349090:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874203935607168:12345-0@lo:8:kworker.0 Request processed in 461us (10552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380521.349098:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380521.349115:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380521.349119:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3298:x1874203935607296:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787380521.349132:0:14856:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1787380521.349146:0:14856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x651a07d11884362d 00002000:00100000:1.0:1787380521.349152:0:14856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d95866a3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787380521.349155:0:14856:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787380521.349157:0:14856:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380521.350466:0:14856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787380521.350495:0:14856:0:(import.c:65:import_set_state_nolock()) ffff9d95866a7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380521.350566:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1874203935607296:12345-0@lo:8:kworker.0 Request processed in 1444us (11005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380521.350575:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787380521.350692:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5117800 x1874203935607168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380521.350867:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380521.350876:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787380521.350885:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787380521.350889:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787380521.350891:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96aaf12000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787380521.350904:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787380521.350909:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935607168:0@lo:8:kworker.0 00010000:00080000:1.0:1787380521.350929:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d96b5114a80 x1874203935607296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380521.350936:0:3298:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380521.350939:0:3298:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787380521.350943:0:3298:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787380521.350946:0:3298:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787380521.350947:0:3298:0:(import.c:65:import_set_state_nolock()) ffff9d96bd214800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787380521.350966:0:3298:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787380521.350970:0:3298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3298:1874203935607296:0@lo:8:kworker.0 00000004:00080000:1.0:1787380521.350998:0:14243:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787380521.352228:0:14246:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787380521.352252:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14246:1874203935607936:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787380521.352311:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380521.352335:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f12d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380521.352776:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607936 00000100:00100000:3.0:1787380521.352785:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607936 00000004:00080000:3.0:1787380521.352800:0:14245:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787380521.353121:0:14245:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471664781483ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787380521.353151:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935607808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380521.353194:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380521.353319:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935607808 00000100:00100000:3.0:1787380521.353328:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935607808 00000100:00100000:3.0:1787380521.353409:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380521.353417:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935607808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380521.353438:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380521.353478:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935607808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380521.353485:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787380521.353531:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9587463b80 x1874203935607808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380521.353550:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935607808:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787380521.353572:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380521.353603:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380521.353609:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14246:x1874203935607936:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787380521.354140:0:14244:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787380521.354158:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14244:1874203935608192:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787380521.355524:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380521.355560:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f12dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380521.355579:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380521.355593:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935608064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380521.355620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380521.355652:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608064 00000100:00100000:0.0:1787380521.355660:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608064 00000100:00100000:0.0:1787380521.355720:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380521.355729:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935608064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380521.355762:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380521.355804:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874203935608064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380521.355811:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787380521.355848:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9587461c00 x1874203935608064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380521.355865:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935608064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787380521.355891:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380521.355907:0:14856:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787380521.355913:0:14856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787380521.356021:0:14859:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787380521.356030:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608192 00000100:00100000:0.0:1787380521.356033:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608192 00000100:00100000:0.0:1787380521.356127:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380521.356134:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14244:x1874203935608192:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787380521.363599:0:14857:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787380521.363611:0:14857:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787380521.363616:0:14857:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00080000:0.0:1787380521.364155:0:15590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787380521.364161:0:15590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787380521.364164:0:15590:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000004:00080000:1.0:1787380521.365032:0:14243:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 471676692325ns, next at 0ns, rc = 0 00002000:00010000:3.0:1787380521.374032:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.374043:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374062:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.374066:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.374073:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374090:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374108:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374116:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374137:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787380521.374622:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.374629:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374638:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.374641:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.374645:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374654:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374660:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374667:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374694:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787380521.374706:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380521.374711:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374719:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.374724:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374733:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374749:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374756:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d118843634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374774:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.374778:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374784:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.374787:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374806:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374817:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374824:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884363b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.374836:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.374838:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.374839:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.375233:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.375239:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375247:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.375250:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.375254:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375264:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375270:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375285:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375299:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.375307:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.375311:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375317:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.375320:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375328:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375365:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375373:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.375387:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.375389:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.375390:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380521.379673:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.385554:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.385573:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.385589:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.385593:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.385599:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.385613:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.385623:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.385631:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.385651:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787380521.386083:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.386090:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386099:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.386103:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.386107:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386116:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386130:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386137:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386155:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787380521.386166:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380521.386171:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386179:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.386184:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386194:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386211:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386218:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843649 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386236:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.386244:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386251:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.386254:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386261:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386270:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386277:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386289:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.386291:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.386293:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.386722:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.386727:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386735:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.386738:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.386742:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386760:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386767:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386775:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386789:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.386797:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.386801:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386807:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.386811:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386819:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386829:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386837:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d118843657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.386858:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.386859:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.386861:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.387437:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.394354:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.394448:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394465:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.394470:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.394476:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394490:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394499:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394518:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394538:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.394557:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.394562:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394584:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.394588:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394597:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394614:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394621:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d11884365e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.394641:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.394643:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.394644:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.401622:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.401634:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401651:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.401655:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.401660:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401677:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401687:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401695:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401726:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380521.401739:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380521.401744:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401752:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:0.0:1787380521.401756:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401765:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401781:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401789:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d118843665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.401805:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.401807:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.401808:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.409925:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.409940:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.409956:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.409960:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.409967:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.409980:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410000:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410007:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410025:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.410038:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.410043:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410050:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.410054:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410063:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410079:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410085:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d11884366c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.410103:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.410109:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.410111:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.410985:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.410994:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411006:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.411009:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.411015:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411026:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411035:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411043:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411063:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.411073:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.411077:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411085:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.411089:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411111:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411123:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411130:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fe46995/0x651a07d118843673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411143:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.411145:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.411146:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.411905:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.411913:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411923:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.411926:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.411930:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411938:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411946:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411961:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.411978:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.411990:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.411994:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412001:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.412006:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412014:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412026:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412033:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c55710/0x651a07d11884367a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412049:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.412051:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.412052:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.412884:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.412899:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412910:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.412914:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.412919:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412929:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412937:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412945:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412962:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.412972:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.412976:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412983:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.412987:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.412995:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.413012:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.413019:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.413033:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.413035:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.413036:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.413304:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.413311:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413320:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.413327:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.413332:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413366:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413374:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413382:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413399:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.413938:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.413944:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413953:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.413956:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.413959:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413968:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413974:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.413987:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.414001:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787380521.414443:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.414450:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.414458:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.414461:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.414465:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.414474:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.414481:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.414489:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.414497:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787380521.415674:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.415684:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.415702:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.416161:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.416170:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.416185:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.416195:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.416203:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.416561:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787380521.416570:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417088:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ea00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.417093:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417104:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417125:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417133:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417169:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380521.417173:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417180:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.417183:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417191:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417201:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417208:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d11884368f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417219:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.417223:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417229:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.417233:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417250:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417260:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417267:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d118843696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.417279:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.417281:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.417283:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.417307:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.418150:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.418158:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418170:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.418174:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.418180:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418191:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418199:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418213:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418231:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.418241:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.418244:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418251:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163be00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.418255:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418263:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418274:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418281:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050cc3b21/0x651a07d1188436a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.418297:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.418299:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.418301:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.419222:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.419236:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.419246:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.419250:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.419254:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.419265:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.419272:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.419279:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.419295:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.419305:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.419310:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.419318:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163aa00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.419322:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.419331:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.420041:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.420048:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d1188436ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.420068:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.420070:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.420072:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.422894:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.422909:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.422926:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.422931:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.422937:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.423255:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.423848:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.423860:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.423869:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.423895:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.423901:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.423908:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ec00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.423912:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.423921:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.423937:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.424612:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d11884369d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.424634:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.424636:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.424638:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.426702:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.426730:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.426738:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.426750:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163ba00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.426762:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.426773:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.426792:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.426799:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d1188436b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.426822:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.426824:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.426825:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.430650:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.430663:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430680:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.430684:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.430690:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430704:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430714:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430734:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430753:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.430767:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.430772:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430779:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.430784:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430793:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430809:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430816:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d1188436b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.430835:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.430836:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.430838:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.433914:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.433926:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380521.434845:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.434863:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.434876:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.434880:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.434887:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.434900:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.434910:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.434917:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.434936:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.434960:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.434965:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.434973:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.434977:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.434985:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.435009:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.435016:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a63bba83/0x651a07d1188436c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.435038:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.435040:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.435041:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.435670:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.435676:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.435682:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.435696:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.435717:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.435724:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.436092:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.436636:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.436644:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.436654:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.436657:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.436662:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.436671:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.436679:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.436685:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.436849:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787380521.437228:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.437234:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.437243:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.437246:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.437250:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.437260:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.437267:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.437273:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438396:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787380521.438407:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438419:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.438423:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438441:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.438442:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787380521.438549:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438558:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c114d31/0x651a07d1188436c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438578:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380521.438581:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438587:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fa00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.438590:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438597:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438607:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438698:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009971b78c/0x651a07d1188436ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438722:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.438726:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438732:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ee00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.438735:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438743:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438760:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438767:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3d2df89/0x651a07d1188436d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.438854:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.438855:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.438857:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.439118:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.439125:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439135:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.439145:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.439150:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439161:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439169:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439176:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439333:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.439824:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.439832:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439842:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.439845:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.439849:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439859:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439867:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.439880:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440146:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380521.440153:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440161:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1fe00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.440165:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440172:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440184:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440190:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5cc507e/0x651a07d1188436dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440220:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.440223:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440230:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.440233:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440240:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440250:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440257:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.440259:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.440260:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.440440:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.440447:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440455:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.440459:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.440463:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440485:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440493:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440500:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440527:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.440536:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.440540:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440550:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.440553:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440561:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440571:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440577:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007914c27a/0x651a07d1188436ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.440599:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.440601:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.440603:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.441442:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.441449:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441460:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.441464:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.441468:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441478:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441486:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441494:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441520:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.441531:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.441535:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441555:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b200 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.441559:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441568:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441581:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441588:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7ffdfe2/0x651a07d1188436f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.441604:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.441605:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.441607:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.442168:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.442175:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442184:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.442188:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.442192:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442202:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442216:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442223:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442237:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.442246:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.442250:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442257:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.442260:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442267:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442279:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442286:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e7abaff/0x651a07d1188436f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.442301:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.442308:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.442310:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.442814:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380521.442821:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6c9f2e6/0x651a07d1188436e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.442960:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.443023:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.443151:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.443157:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.443166:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.443169:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.443173:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.443182:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.443190:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.443196:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.443216:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.443924:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.443932:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787380521.443951:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787380521.444049:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380521.444055:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.444063:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216de00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380521.444067:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.444093:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.444111:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.444119:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000897d32fe/0x651a07d1188436ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.444137:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380521.444139:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380521.444141:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787380521.444968:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787380521.445462:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.445468:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.445476:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.445493:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.445513:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.445521:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.445594:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.446110:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.446119:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.446129:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.446132:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.446136:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.446146:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.446154:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.446163:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380521.446248:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.446255:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.446264:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.446267:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.446277:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.446287:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.446295:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.446303:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446551:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787380521.446559:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446578:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.446582:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446593:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446612:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446619:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035e94a44/0x651a07d118843706 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446638:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380521.446642:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446647:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.446650:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446657:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446667:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446680:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.446684:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.446690:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.446693:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.446795:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380521.446801:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c96e7ec5/0x651a07d11884370d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.446826:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.447311:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.447323:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.447331:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.447334:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.447440:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.447451:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.447459:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.447466:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.447485:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380521.447491:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.447823:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.447846:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.447855:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.447857:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.447859:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.448234:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.448241:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.448251:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.448254:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.448258:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.448277:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.448286:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.448294:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.448374:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.448380:0:14857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a602058c/0x651a07d118843714 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380521.449025:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.449032:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.449041:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.449044:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.449049:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.449058:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.449076:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.449084:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449202:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380521.449209:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449217:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.449221:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449240:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449254:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449262:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.449265:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449271:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.449274:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449281:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449290:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.449296:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.449298:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.449300:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.449495:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380521.449510:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018b64599/0x651a07d118843722 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380521.450103:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.450110:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450121:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.450124:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.450129:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450140:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450160:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450167:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450177:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.450668:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.450674:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450683:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.450686:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.450690:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450699:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450770:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450779:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.450798:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787380521.451244:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.451252:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.451260:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.451263:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.451266:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.451274:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.451280:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.451287:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.451295:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787380521.451468:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787380521.451476:0:14857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000418e5c3e/0x651a07d118843729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380521.452110:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.452117:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.452126:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.452130:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.452134:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.452145:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.452154:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.452171:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.452179:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787380521.453061:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.453069:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453079:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.453082:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.453086:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453094:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453102:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453109:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453116:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787380521.453662:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.453669:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.453679:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.453687:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.453692:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.453703:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453832:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787380521.453839:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453853:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ea00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.453858:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453868:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453884:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453891:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ce2762/0x651a07d118843730 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453909:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787380521.453913:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453919:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1ec00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.453922:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.453930:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380521.453955:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.453960:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453974:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.453977:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.453982:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453991:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.453999:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.454007:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454010:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.454015:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1787380521.454023:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003336a0c2/0x651a07d118843737 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454036:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787380521.454040:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454047:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55200 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.454050:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454058:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454069:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454076:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026417501/0x651a07d11884373e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454087:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787380521.454091:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454098:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216d600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.454105:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454113:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454124:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454131:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc98dc3b/0x651a07d118843745 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454147:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380521.454151:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454157:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.454160:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454168:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454177:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454185:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003edd1f63/0x651a07d11884374c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454203:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.454207:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454213:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.454216:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454223:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454231:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454237:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e788dc8/0x651a07d11884375a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454247:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.454248:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.454250:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.454520:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.454528:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.454544:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380521.454804:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.454809:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454816:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55a00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.454825:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454834:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454846:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454852:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aef3f8ed/0x651a07d118843753 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.454865:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.454867:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.454868:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.454966:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.454972:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.454980:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.454983:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.454989:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.454999:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.455018:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.455025:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.455044:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.455187:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.455193:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.455201:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.455204:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.455208:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.455217:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.455224:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.455237:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.455245:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787380521.455441:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380521.455802:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455814:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.455818:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455826:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455839:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380521.455842:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.455848:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455852:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d63841d/0x651a07d118843761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.455856:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.455859:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.455863:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455870:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.455872:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455874:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.455881:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455881:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54200 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.455884:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.455888:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455892:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455901:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.455905:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380521.455907:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c5f5c01/0x651a07d118843768 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.455917:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.455920:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.456025:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163ba00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.456034:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.456042:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.456053:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.456060:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac12c8af/0x651a07d11884376f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.456074:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.456076:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.456078:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380521.456432:0:14857:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787380521.456439:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456447:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=471s v=(0 0) 00010000:00010000:3.0:1787380521.456450:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380521.456453:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.456512:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380521.456521:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.456529:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f600 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380521.456533:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.456541:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456548:0:14857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.456554:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456556:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456563:0:14857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.456572:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000373b1103/0x651a07d11884371b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456578:0:14857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.456586:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380521.456589:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.456590:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380521.456591:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380521.456593:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.456597:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163aa00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:2.0:1787380521.456597:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380521.456598:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.456606:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456614:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456625:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456708:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033fe0066/0x651a07d118843776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.456724:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.456725:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.456727:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787380521.456912:0:14857:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1787380521.457010:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14246:x1874203935607936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 103396us (104695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380521.457019:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380521.457047:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14246:1874203935607936:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787380521.457062:0:14246:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00002000:00010000:0.0:1787380521.457116:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:1.0:1787380521.457120:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14246:1874203935608320:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1787380521.457122:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.457130:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.457132:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.457136:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.457145:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380521.457151:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380521.457153:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.457160:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.457178:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787380521.457193:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f153300 going to sleep for 11 seconds 00000100:00100000:2.0:1787380521.457241:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608320 00000100:00100000:2.0:1787380521.457248:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608320 00000100:00100000:2.0:1787380521.457320:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380521.457329:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14246:x1874203935608320:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1787380521.457418:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.457423:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.457431:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54a00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.457434:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.457443:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787380521.457500:0:14859:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1787380521.457597:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.457606:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000739c46ab/0x651a07d11884377d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.457619:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.457621:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.457623:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.458005:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.458012:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458026:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.458030:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.458034:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458043:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458050:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458057:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458081:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380521.458450:0:15594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.458456:0:15594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458464:0:15594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55e00 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.458468:0:15594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458482:0:15594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458495:0:15594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458515:0:15594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d88e9f2c/0x651a07d118843784 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380521.458523:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787380521.458528:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.458529:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458530:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.458532:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.458536:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.458539:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.458543:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458552:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458571:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458577:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.458598:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380521.458790:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380521.458795:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458803:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380521.458806:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458814:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458824:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458843:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034181b1e/0x651a07d11884378b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380521.458856:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.458857:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380521.458858:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.459798:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.459808:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.459820:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.459824:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.459829:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.459840:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.459848:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.459855:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.459924:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380521.460395:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.460402:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.460410:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.460415:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.460424:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.460440:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.460447:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eb71d33/0x651a07d118843792 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.460564:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.460566:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.460568:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380521.460812:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.460818:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.460828:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.460832:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.460836:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.460846:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.460853:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.460860:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.460919:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380521.461334:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.461357:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.461366:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.461375:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.461379:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.461388:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.461396:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.461402:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461589:0:15594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380521.461594:0:15594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461602:0:15594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.461606:0:15594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461613:0:15594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461626:0:15594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461711:0:15594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a7d748/0x651a07d118843799 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461749:0:15594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.461752:0:15594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461759:0:15594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.461769:0:15594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461777:0:15594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461787:0:15594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.461795:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.461796:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.461798:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.461865:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380521.461871:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905fa69c/0x651a07d1188437a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380521.462264:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.462271:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.462292:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.462296:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.462308:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.462318:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.462333:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.462359:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.462513:0:14209:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.462519:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.462527:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54800 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.462530:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.462537:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.462548:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.462556:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.462564:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.462566:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.462699:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380521.462705:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029a62bc0/0x651a07d1188437a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380521.463119:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787380521.463125:0:15590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.463134:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1787380521.463137:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380521.463142:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.463151:0:15590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.463160:0:15590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380521.463179:0:15590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.463208:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380521.463213:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.463221:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380521.463224:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.463233:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.463244:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380521.463252:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.463254:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.463255:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380521.463802:0:15590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380521.463808:0:15590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5bd0bbb/0x651a07d1188437ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787380521.464020:0:15590:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1787380521.464105:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14244:x1874203935608192:12345-0@lo:5:osp-pre-0-0.0 Request processed in 107968us (108581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380521.464115:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380521.464169:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14244:1874203935608192:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787380521.464182:0:14244:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1787380521.464226:0:14244:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14244:1874203935608448:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787380521.464258:0:14244:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380521.464438:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380521.464452:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608448 00000100:00100000:3.0:1787380521.464458:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608448 00000100:00100000:3.0:1787380521.464512:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380521.464521:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14244:x1874203935608448:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787380521.464557:0:14856:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1787380521.464738:0:14244:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96be489780 going to sleep for 11 seconds 00000100:00100000:2.0:1787380521.469524:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14246:x1874203935608320:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12189us (12365us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787380521.469537:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380521.469770:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14246:1874203935608320:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787380521.469787:0:14246:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787380521.483448:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14244:x1874203935608448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18922us (19183us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787380521.483460:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380521.485015:0:14244:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14244:1874203935608448:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787380521.485034:0:14244:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787380521.911555:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380522.300846:0:14218:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787380522.300853:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d96bcdf7800 from 8 10000000:01000000:3.0:1787380522.300858:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787380522.300899:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188437b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.300910:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188437b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.300919:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188437b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380522.300942:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935608576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380522.301000:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380522.301039:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2d9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380522.301058:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608576 00000100:00100000:3.0:1787380522.301063:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608576 00000100:00100000:3.0:1787380522.301106:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787380522.301114:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935608576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380522.301126:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380522.301138:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163aa00/0x651a07d1188437bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d1188437b5 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.301159:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163aa00/0x651a07d1188437bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d1188437b5 expref: 19 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.301171:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163aa00/0x651a07d1188437bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188437b5 expref: 19 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.301180:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163aa00, rc 0) 00000100:00100000:3.0:1787380522.301224:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935608576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380522.301231:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787380522.301286:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935608576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380522.301299:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188437b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188437bc expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.301306:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188437b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d1188437bc expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380522.301371:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935608704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787380522.301401:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380522.301415:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2d9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380522.307396:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608704 00000100:00100000:1.0:1787380522.307409:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608704 00000100:00100000:1.0:1787380522.307463:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787380522.307473:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935608704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787380522.307511:0:14216:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787380522.307533:0:14216:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787380522.307537:0:14216:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787380522.307658:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935608704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 186us (6254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380522.307666:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787380522.309371:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935608704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787380522.309441:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787380522.309451:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188437b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188437bc expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.309462:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163b800/0x651a07d1188437b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d1188437bc expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380522.935545:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380523.959503:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787380524.350699:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787380524.350716:0:6603:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1787380524.984476:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787380525.896064:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787380525.896084:0:7479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1787380526.009405:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380526.237582:0:15883:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg614-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787380526.839730:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380526.839753:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935608832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380526.839818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380526.839974:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608832 00000100:00100000:2.0:1787380526.839982:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608832 00000100:00100000:2.0:1787380526.840042:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380526.840052:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935608832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380526.840083:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380526.840139:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935608832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.840158:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380526.840210:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787380526.840235:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935608832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787380526.840512:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380526.841874:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935609088:0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.841926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380526.841953:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380526.841958:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935609216:0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.841983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380526.842030:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609216 00000100:00100000:2.0:1787380526.842037:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609216 00000100:00100000:2.0:1787380526.842078:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380526.842085:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935609216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.842141:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874203935609216:12345-0@lo:400:kworker.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.842148:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380526.842172:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935609344:0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.842196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380526.842212:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787380526.842217:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935608960:0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.842242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380526.842264:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9698da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935609472:0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.842298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380526.842319:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609344 00000100:00100000:2.0:1787380526.842322:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609344 00000100:00100000:2.0:1787380526.842369:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609472 00000100:00100000:2.0:1787380526.842379:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609472 00000100:00100000:2.0:1787380526.842398:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380526.842403:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935609344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.842437:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874203935609344:12345-0@lo:400:kworker.0 Request processed in 33us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.842442:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380526.842453:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380526.842458:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935609472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.842495:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935609472:12345-0@lo:400:kworker.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.842501:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380526.842517:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935608960 00000100:00100000:2.0:1787380526.842520:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935608960 00000100:00100000:2.0:1787380526.842542:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787380526.842548:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3299:x1874203935608960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.842575:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3299:x1874203935608960:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.842581:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787380526.843381:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935609600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380526.843413:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609088 00000100:00100000:3.0:1787380526.843414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380526.843426:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609088 00010000:00080000:3.0:1787380526.843450:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698da7800 x1874203935609216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380526.843459:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380526.843463:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874203935609216:0@lo:400:kworker.0 00000100:00100000:0.0:1787380526.843465:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935609088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380526.843507:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935608960:0@lo:400:kworker.0 00010000:00080000:3.0:1787380526.843519:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698da6680 x1874203935609472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380526.843519:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935609088:12345-0@lo:400:kworker.0 Request processed in 55us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380526.843526:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380526.843528:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935609472:0@lo:400:kworker.0 00010000:00080000:3.0:1787380526.843536:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d9698da7100 x1874203935609344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380526.843544:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3299:1874203935609344:0@lo:400:kworker.0 00000100:00080000:0.0:1787380526.843546:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380526.843550:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380526.843567:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787380526.843577:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9698da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935609088:0@lo:400:kworker.0 00000100:00100000:2.0:1787380526.844267:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609600 00000100:00100000:2.0:1787380526.844274:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609600 00000100:00100000:2.0:1787380526.844312:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380526.844320:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935609600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380526.844412:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380526.844519:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935609600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.844526:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380526.845435:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5117100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935609600:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787380527.031557:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380528.055548:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380528.393015:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380528.393192:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915690368 00000100:00100000:3.0:1787380528.393204:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915690368 00000100:00100000:3.0:1787380528.393295:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:3.0:1787380528.393307:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2352:x1874203915690368:12345-192.168.206.14@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787380528.393480:0:14214:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 66f4b893-e0f2-4d86-a3f0-eb1a2023213c@192.168.206.14@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1787380528.393518:0:14214:0:(genops.c:1406:class_connect()) connect: client 66f4b893-e0f2-4d86-a3f0-eb1a2023213c, cookie 0x651a07d1188437c3 00000100:00080000:3.0:1787380528.393823:0:14214:0:(import.c:65:import_set_state_nolock()) ffff9d9585fcc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380528.395519:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+5:2352:x1874203915690368:12345-192.168.206.14@tcp:250:mount.lustre.0 Request processed in 2201us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.395558:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 76 00000100:00100000:3.0:1787380528.421419:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.421985:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915690496 00000100:00100000:2.0:1787380528.422066:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915690496 00000100:00100000:2.0:1787380528.422129:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 77 00000100:00100000:2.0:1787380528.422140:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+5:13706:x1874203915690496:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787380528.422156:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380528.422174:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2e00/0x651a07d1188437ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b01 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.422203:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2e00/0x651a07d1188437ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b01 expref: 6 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.422214:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2e00/0x651a07d1188437ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b01 expref: 6 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.422223:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2e00, rc 0) 00000100:00100000:2.0:1787380528.422275:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+6:13706:x1874203915690496:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 137us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.422283:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 77 00000100:00100000:1.0:1787380528.426537:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380528.426686:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915690624 00000100:00100000:3.0:1787380528.426699:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915690624 00000100:00100000:3.0:1787380528.426792:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:3.0:1787380528.426803:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+6:13706:x1874203915690624:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380528.427201:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+6:13706:x1874203915690624:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 397us (676us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380528.427211:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 78 00000100:00100000:0.0:1787380528.431306:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380528.431490:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915690752 00000100:00100000:3.0:1787380528.431501:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915690752 00000100:00100000:3.0:1787380528.431557:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:3.0:1787380528.431643:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+6:13706:x1874203915690752:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787380528.431660:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380528.431743:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b200/0x651a07d1188437d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b08 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.431771:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b200/0x651a07d1188437d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b08 expref: 7 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.431782:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b200/0x651a07d1188437d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b08 expref: 7 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.431791:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b200, rc 0) 00000100:00100000:3.0:1787380528.431846:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+7:13706:x1874203915690752:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 281us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.431869:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 79 00000100:00100000:0.0:1787380528.434680:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.435224:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915690880 00000100:00100000:2.0:1787380528.435242:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915690880 00000100:00100000:2.0:1787380528.435330:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:2.0:1787380528.435545:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+7:13706:x1874203915690880:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787380528.436379:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13706:x1874203915690880:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 1034us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.436391:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 80 00000100:00100000:1.0:1787380528.444645:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.444950:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691008 00000100:00100000:0.0:1787380528.444962:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691008 00000100:00100000:0.0:1787380528.445135:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 81 00000100:00100000:0.0:1787380528.445149:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13706:x1874203915691008:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787380528.445994:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13706:x1874203915691008:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 841us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.446006:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 81 00000100:00100000:0.0:1787380528.461909:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.462113:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691136 00000100:00100000:2.0:1787380528.462144:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691136 00000100:00100000:2.0:1787380528.462210:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:2.0:1787380528.462221:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958496dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13725:x1874203915691136:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380528.462768:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958496dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13725:x1874203915691136:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 544us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.463383:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 82 00000100:00100000:1.0:1787380528.487513:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.487873:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691264 00000100:00100000:0.0:1787380528.487886:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691264 00000100:00100000:0.0:1787380528.487961:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 83 00000100:00100000:0.0:1787380528.487972:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13725:x1874203915691264:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380528.488641:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13725:x1874203915691264:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 665us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.488666:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 83 00000100:00100000:1.0:1787380528.498253:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.498399:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691392 00000100:00100000:2.0:1787380528.498412:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691392 00000100:00100000:2.0:1787380528.498487:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 84 00000100:00100000:2.0:1787380528.498499:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+8:13706:x1874203915691392:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787380528.498520:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380528.498542:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2600/0x651a07d1188437d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b32 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.498577:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2600/0x651a07d1188437d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b32 expref: 9 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.498591:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2600/0x651a07d1188437d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b32 expref: 9 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.498603:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2600, rc 0) 00000100:00100000:2.0:1787380528.498678:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+9:13706:x1874203915691392:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 181us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.498687:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 84 00000100:00100000:2.0:1787380528.515929:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.517969:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691520 00000100:00100000:0.0:1787380528.517990:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691520 00000100:00100000:0.0:1787380528.518088:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:0.0:1787380528.518101:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+9:13706:x1874203915691520:12345-192.168.206.14@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787380528.518138:0:14214:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787380528.518170:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787380528.518175:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787380528.518179:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787380528.518181:0:14214:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787380528.524406:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+9:13706:x1874203915691520:12345-192.168.206.14@tcp:256:mount.lustre.0 Request processed in 6289us (8473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.524425:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 85 00000100:00100000:3.0:1787380528.530455:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.531069:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691648 00000100:00100000:2.0:1787380528.531086:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691648 00000100:00100000:2.0:1787380528.531875:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 86 00000100:00100000:2.0:1787380528.531896:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+9:13706:x1874203915691648:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787380528.531922:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380528.531947:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b39 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.531985:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 10 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.531999:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 10 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380528.532009:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2800, rc 0) 00000100:00100000:2.0:1787380528.532107:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13706:x1874203915691648:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 219us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.532116:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 86 00000100:00100000:2.0:1787380528.538992:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.539224:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691776 00000100:00100000:0.0:1787380528.539237:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691776 00000100:00100000:0.0:1787380528.539308:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 87 00000100:00100000:0.0:1787380528.539320:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13706:x1874203915691776:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787380528.541070:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13706:x1874203915691776:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 1726us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.541088:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 87 00000100:00100000:0.0:1787380528.562884:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.563013:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915691904 00000100:00100000:2.0:1787380528.563026:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915691904 00000100:00100000:2.0:1787380528.563278:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 88 00000100:00100000:2.0:1787380528.563291:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13706:x1874203915691904:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787380528.563726:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13706:x1874203915691904:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 435us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.563736:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 88 00000040:00080000:1.0:1787380528.568480:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787380528.569314:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.569501:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692032 00000100:00100000:0.0:1787380528.569512:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692032 00000100:00100000:0.0:1787380528.569570:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 89 00000100:00100000:0.0:1787380528.569580:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13729:x1874203915692032:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380528.570462:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13729:x1874203915692032:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 879us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.570484:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 89 00000100:00100000:0.0:1787380528.575609:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.582442:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692160 00000100:00100000:2.0:1787380528.582550:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692160 00000100:00100000:2.0:1787380528.582830:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 90 00000100:00100000:2.0:1787380528.582842:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13729:x1874203915692160:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380528.583887:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13729:x1874203915692160:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 1043us (8297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.583898:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 90 00000100:00100000:1.0:1787380528.601684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.601785:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692288 00000100:00100000:2.0:1787380528.601794:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692288 00000100:00100000:2.0:1787380528.601857:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:2.0:1787380528.601865:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1874203915692288:12345-192.168.206.14@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787380528.601896:0:14223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from b07ef607-e154-4d63-8e5d-8040f62f63ba@192.168.206.14@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1787380528.601942:0:14223:0:(genops.c:1406:class_connect()) connect: client b07ef607-e154-4d63-8e5d-8040f62f63ba, cookie 0x651a07d1188437e6 00000004:00100000:2.0:1787380528.601972:0:14223:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787380528.601978:0:14223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787380528.650424:0:14223:0:(import.c:65:import_set_state_nolock()) ffff9d9585fcb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380528.650602:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:2352:x1874203915692288:12345-192.168.206.14@tcp:38:mount.lustre.0 Request processed in 48734us (48925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.650616:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:1.0:1787380528.668455:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380528.668534:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.668646:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692544 00000100:00100000:0.0:1787380528.668660:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692544 00000100:00100000:0.0:1787380528.668760:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692416 00000100:00100000:0.0:1787380528.668764:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692416 00000100:00100000:0.0:1787380528.668799:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:0.0:1787380528.668811:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:13706:x1874203915692544:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787380528.668869:0:14222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787380528.668978:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:13706:x1874203915692544:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 169us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.668987:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:0.0:1787380528.669010:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:0.0:1787380528.669018:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:0:x1874203915692416:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787380528.669031:0:14222:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787380528.669055:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:0:x1874203915692416:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 38us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.669062:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00080000:1.0:1787380528.669262:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380528.673199:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.673852:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692672 00000100:00100000:2.0:1787380528.673866:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692672 00000100:00100000:2.0:1787380528.673947:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:2.0:1787380528.673961:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:13706:x1874203915692672:12345-192.168.206.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787380528.674084:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:13706:x1874203915692672:12345-192.168.206.14@tcp:40:mount.lustre.0 Request processed in 127us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.674093:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:2.0:1787380528.676608:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380528.676659:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.676856:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693056 00000100:00100000:3.0:1787380528.676866:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692800 00000100:00100000:0.0:1787380528.676867:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693056 00000100:00100000:3.0:1787380528.676870:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692800 00000100:00100000:3.0:1787380528.676916:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:0.0:1787380528.676917:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:3.0:1787380528.676926:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1874203915692800:12345-192.168.206.14@tcp:8:mount.lustre.0 00000100:00100000:0.0:1787380528.676926:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:13706:x1874203915693056:12345-192.168.206.14@tcp:33:mount.lustre.0 00010000:00080000:3.0:1787380528.676963:0:14857:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from b07ef607-e154-4d63-8e5d-8040f62f63ba@192.168.206.14@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1787380528.676998:0:14857:0:(genops.c:1406:class_connect()) connect: client b07ef607-e154-4d63-8e5d-8040f62f63ba, cookie 0x651a07d1188437ed 00002000:00100000:3.0:1787380528.677012:0:14857:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b07ef607-e154-4d63-8e5d-8040f62f63ba/ffff9d9585fc9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787380528.677025:0:14857:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787380528.677498:0:14857:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787380528.677537:0:14857:0:(import.c:65:import_set_state_nolock()) ffff9d9585fc8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380528.677623:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:2352:x1874203915692800:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 697us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.677633:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:2.0:1787380528.678012:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380528.678067:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915692928 00000100:00100000:3.0:1787380528.678073:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915692928 00000100:00100000:3.0:1787380528.678116:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:3.0:1787380528.678122:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1874203915692928:12345-192.168.206.14@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787380528.678147:0:15590:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from b07ef607-e154-4d63-8e5d-8040f62f63ba@192.168.206.14@tcp t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1787380528.678239:0:15590:0:(genops.c:1406:class_connect()) connect: client b07ef607-e154-4d63-8e5d-8040f62f63ba, cookie 0x651a07d1188437f4 00002000:00100000:3.0:1787380528.678251:0:15590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b07ef607-e154-4d63-8e5d-8040f62f63ba/ffff9d969f4b1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787380528.678262:0:15590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787380528.678564:0:15590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787380528.681414:0:15590:0:(import.c:65:import_set_state_nolock()) ffff9d969f4b0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380528.681534:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:2352:x1874203915692928:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 3403us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.681547:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000004:00080000:1.0:1787380528.683898:0:14224:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6895us 00000004:00200000:0.0:1787380528.707185:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787380528.707438:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:13706:x1874203915693056:12345-192.168.206.14@tcp:33:mount.lustre.0 Request processed in 30504us (30835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.707452:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:2.0:1787380528.923215:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380528.923373:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693184 00000100:00100000:0.0:1787380528.923383:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693184 00000100:00100000:0.0:1787380528.923452:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:0.0:1787380528.923473:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:13750:x1874203915693184:12345-192.168.206.14@tcp:101:mkdir.0 00010000:00010000:0.0:1787380528.923492:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380528.923515:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188437fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b63 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.923579:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55a00/0x651a07d118843802 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.923592:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55a00/0x651a07d118843802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.923607:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55a00/0x651a07d118843802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380528.924163:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787380528.924168:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380528.924262:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55a00/0x651a07d118843802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.924293:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188437fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b63 expref: 8 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.924309:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55a00/0x651a07d118843802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b63 expref: 7 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.924330:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:0.0:1787380528.924333:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380528.924377:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55a00, rc 0) 00000100:00100000:0.0:1787380528.926112:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:13750:x1874203915693184:12345-192.168.206.14@tcp:101:mkdir.0 Request processed in 2518us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.926125:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00010000:00010000:3.0:1787380529.082133:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787380529.439934:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b07ef607-e154-4d63-8e5d-8040f62f63ba 00010000:00010000:3.0:1787380530.104857:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380530.754782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380530.758915:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693312 00000100:00100000:2.0:1787380530.758942:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693312 00000100:00100000:2.0:1787380530.759087:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:2.0:1787380530.759097:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:13803:x1874203915693312:12345-192.168.206.14@tcp:41:lfs.0 00000004:00000024:2.0:1787380530.759135:0:14223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787380530.759219:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:13803:x1874203915693312:12345-192.168.206.14@tcp:41:lfs.0 Request processed in 124us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380530.759226:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00080000:1.0:1787380530.760969:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380530.764306:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380530.764493:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693440 00000100:00100000:3.0:1787380530.764506:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693440 00000100:00100000:3.0:1787380530.764583:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:3.0:1787380530.764596:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:13803:x1874203915693440:12345-192.168.206.14@tcp:13:lfs.0 00002000:00000024:3.0:1787380530.764641:0:14861:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380530.764823:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:13803:x1874203915693440:12345-192.168.206.14@tcp:13:lfs.0 Request processed in 232us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380530.764835:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00080000:1.0:1787380530.766685:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380530.772621:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380530.772798:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693568 00000100:00100000:2.0:1787380530.772808:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693568 00000100:00100000:2.0:1787380530.772904:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:2.0:1787380530.772916:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:13803:x1874203915693568:12345-192.168.206.14@tcp:13:lfs.0 00002000:00000024:2.0:1787380530.772952:0:14861:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787380530.773170:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:13803:x1874203915693568:12345-192.168.206.14@tcp:13:lfs.0 Request processed in 255us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380530.773178:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00080000:1.0:1787380530.773423:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380530.953544:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380530.954509:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693696 00000100:00100000:2.0:1787380530.954522:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693696 00000100:00100000:2.0:1787380530.954587:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 91 00000100:00100000:2.0:1787380530.954598:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+10:13832:x1874203915693696:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787380530.954613:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380530.954631:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff3c00/0x651a07d118843809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b6a expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380530.954674:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff3c00/0x651a07d118843809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b6a expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380530.954706:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff3c00/0x651a07d118843809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b6a expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380530.954716:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3c00, rc 0) 00000100:00100000:2.0:1787380530.954773:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13832:x1874203915693696:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 176us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380530.954780:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 91 00000100:00100000:2.0:1787380530.964987:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380530.965068:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693824 00000100:00100000:3.0:1787380530.965078:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693824 00000100:00100000:3.0:1787380530.965129:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 92 00000100:00100000:3.0:1787380530.965138:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13832:x1874203915693824:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380530.965412:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13832:x1874203915693824:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 274us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380530.965427:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 92 00000100:00100000:0.0:1787380530.971588:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380530.971720:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915693952 00000100:00100000:3.0:1787380530.971731:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915693952 00000100:00100000:3.0:1787380530.971777:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 93 00000100:00100000:3.0:1787380530.971786:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13832:x1874203915693952:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787380530.971978:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13832:x1874203915693952:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 192us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380530.971987:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 93 00000100:00100000:2.0:1787380531.000164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.001821:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694080 00000100:00100000:3.0:1787380531.001835:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694080 00000100:00100000:3.0:1787380531.001892:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 94 00000100:00100000:3.0:1787380531.001902:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13842:x1874203915694080:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380531.002161:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13842:x1874203915694080:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 260us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.002170:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 94 00000001:00100000:1.0:1787380531.005850:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b07ef607-e154-4d63-8e5d-8040f62f63ba 00000100:00100000:3.0:1787380531.026911:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380531.027023:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694208 00000100:00100000:0.0:1787380531.027033:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694208 00000100:00100000:0.0:1787380531.027083:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 95 00000100:00100000:0.0:1787380531.027092:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13842:x1874203915694208:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380531.027375:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13842:x1874203915694208:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 283us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380531.027384:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 95 00000100:00100000:3.0:1787380531.030300:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380531.030412:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694336 00000100:00100000:0.0:1787380531.030421:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694336 00000100:00100000:0.0:1787380531.030482:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 96 00000100:00100000:0.0:1787380531.030492:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13832:x1874203915694336:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787380531.030507:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380531.030523:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af55e00/0x651a07d118843810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b94 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380531.030550:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55e00/0x651a07d118843810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b94 expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380531.030573:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af55e00/0x651a07d118843810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b94 expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380531.030582:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55e00, rc 0) 00000100:00100000:0.0:1787380531.030685:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13832:x1874203915694336:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 194us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380531.030693:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 96 00000100:00100000:2.0:1787380531.040619:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.040696:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694464 00000100:00100000:3.0:1787380531.040705:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694464 00000100:00100000:3.0:1787380531.040754:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 97 00000100:00100000:3.0:1787380531.040762:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13832:x1874203915694464:12345-192.168.206.14@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787380531.040784:0:14214:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787380531.040807:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787380531.040811:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787380531.040814:0:14214:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787380531.040820:0:14214:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787380531.043136:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13832:x1874203915694464:12345-192.168.206.14@tcp:256:mount.lustre.0 Request processed in 2365us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.043153:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 97 00000100:00100000:0.0:1787380531.049241:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.049323:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694592 00000100:00100000:3.0:1787380531.049372:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694592 00000100:00100000:3.0:1787380531.049417:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 98 00000100:00100000:3.0:1787380531.049426:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bfd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13832:x1874203915694592:12345-192.168.206.14@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787380531.049441:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380531.049469:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6b9b expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.049497:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.049508:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.049518:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b600, rc 0) 00000100:00100000:3.0:1787380531.049576:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bfd9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13832:x1874203915694592:12345-192.168.206.14@tcp:101:mount.lustre.0 Request processed in 150us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.049583:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 98 00000100:00100000:2.0:1787380531.051862:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.052162:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694720 00000100:00100000:3.0:1787380531.052171:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694720 00000100:00100000:3.0:1787380531.052274:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 99 00000100:00100000:3.0:1787380531.052283:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13832:x1874203915694720:12345-192.168.206.14@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380531.052617:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13832:x1874203915694720:12345-192.168.206.14@tcp:501:mount.lustre.0 Request processed in 333us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.052634:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 99 00000100:00100000:2.0:1787380531.062523:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380531.063496:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694848 00000100:00100000:0.0:1787380531.063507:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694848 00000100:00100000:0.0:1787380531.063575:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 100 00000100:00100000:0.0:1787380531.063585:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13832:x1874203915694848:12345-192.168.206.14@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787380531.063818:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13832:x1874203915694848:12345-192.168.206.14@tcp:503:mount.lustre.0 Request processed in 234us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380531.063826:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 100 00000100:00100000:1.0:1787380531.067766:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.068007:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915694976 00000100:00100000:3.0:1787380531.068017:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915694976 00000100:00100000:3.0:1787380531.068072:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 101 00000100:00100000:3.0:1787380531.068083:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13845:x1874203915694976:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380531.068536:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13845:x1874203915694976:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 453us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.068545:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 101 00000100:00100000:2.0:1787380531.073044:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.073132:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915695104 00000100:00100000:3.0:1787380531.073142:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915695104 00000100:00100000:3.0:1787380531.073197:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 102 00000100:00100000:3.0:1787380531.073207:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95810d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13845:x1874203915695104:12345-192.168.206.14@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380531.073616:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95810d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13845:x1874203915695104:12345-192.168.206.14@tcp:502:llog_process_th.0 Request processed in 408us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.073625:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 102 00000100:00100000:2.0:1787380531.084811:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380531.084965:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915695232 00000100:00100000:0.0:1787380531.084975:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915695232 00000100:00100000:0.0:1787380531.085019:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:0.0:1787380531.085042:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1874203915695232:12345-192.168.206.14@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787380531.085071:0:14221:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 83f5759c-3f6c-4648-962a-0ba61afad3eb@192.168.206.14@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:0.0:1787380531.085105:0:14221:0:(genops.c:1406:class_connect()) connect: client 83f5759c-3f6c-4648-962a-0ba61afad3eb, cookie 0x651a07d11884381e 00000004:00100000:0.0:1787380531.085131:0:14221:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787380531.085232:0:14221:0:(import.c:65:import_set_state_nolock()) ffff9d9585a46000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380531.085298:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:2352:x1874203915695232:12345-192.168.206.14@tcp:38:mount.lustre.0 Request processed in 270us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380531.085318:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:1.0:1787380531.094924:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380531.094969:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.095052:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915695360 00000100:00100000:3.0:1787380531.095062:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915695360 00000100:00100000:3.0:1787380531.095120:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915695488 00000100:00100000:3.0:1787380531.095124:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915695488 00000100:00100000:3.0:1787380531.095139:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1787380531.095152:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+7:0:x1874203915695360:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380531.095512:0:14221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787380531.095581:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+7:0:x1874203915695360:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 428us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.095589:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1787380531.095626:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1787380531.095633:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:13832:x1874203915695488:12345-192.168.206.14@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380531.095646:0:14221:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787380531.096126:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:13832:x1874203915695488:12345-192.168.206.14@tcp:41:mount.lustre.0 Request processed in 491us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.096134:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00080000:1.0:1787380531.096207:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380531.107552:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380531.107849:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915695616 00000100:00100000:2.0:1787380531.107858:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915695616 00000100:00100000:2.0:1787380531.107915:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:2.0:1787380531.107926:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:13832:x1874203915695616:12345-192.168.206.14@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787380531.108006:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:13832:x1874203915695616:12345-192.168.206.14@tcp:40:mount.lustre.0 Request processed in 82us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380531.108013:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:2.0:1787380531.109970:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380531.110065:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915695744 00000100:00100000:1.0:1787380531.110074:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915695744 00000100:00100000:1.0:1787380531.110117:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:1.0:1787380531.110126:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1874203915695744:12345-192.168.206.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787380531.110160:0:14856:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 83f5759c-3f6c-4648-962a-0ba61afad3eb@192.168.206.14@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:1.0:1787380531.110200:0:14856:0:(genops.c:1406:class_connect()) connect: client 83f5759c-3f6c-4648-962a-0ba61afad3eb, cookie 0x651a07d118843825 00002000:00100000:1.0:1787380531.110212:0:14856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83f5759c-3f6c-4648-962a-0ba61afad3eb/ffff9d95866a5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380531.110222:0:14856:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380531.110545:0:14856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787380531.110574:0:14856:0:(import.c:65:import_set_state_nolock()) ffff9d95866a5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380531.110644:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:2352:x1874203915695744:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 518us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380531.111421:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:3.0:1787380531.111898:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380531.112040:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915695872 00000100:00100000:1.0:1787380531.112047:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915695872 00000100:00100000:1.0:1787380531.112081:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:1.0:1787380531.112088:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1874203915695872:12345-192.168.206.14@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787380531.112115:0:14859:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 83f5759c-3f6c-4648-962a-0ba61afad3eb@192.168.206.14@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:1.0:1787380531.112139:0:14859:0:(genops.c:1406:class_connect()) connect: client 83f5759c-3f6c-4648-962a-0ba61afad3eb, cookie 0x651a07d11884382c 00002000:00100000:1.0:1787380531.112149:0:14859:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 83f5759c-3f6c-4648-962a-0ba61afad3eb/ffff9d95866a7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380531.112158:0:14859:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380531.112580:0:14859:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787380531.112722:0:14859:0:(import.c:65:import_set_state_nolock()) ffff9d95866a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380531.112837:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:2352:x1874203915695872:12345-192.168.206.14@tcp:8:mount.lustre.0 Request processed in 748us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380531.112846:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:2.0:1787380531.118011:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380531.118230:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696000 00000100:00100000:1.0:1787380531.118240:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696000 00000100:00100000:1.0:1787380531.118328:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:1.0:1787380531.118355:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:13832:x1874203915696000:12345-192.168.206.14@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787380531.118621:0:14225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787380531.118781:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:13832:x1874203915696000:12345-192.168.206.14@tcp:33:mount.lustre.0 Request processed in 441us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380531.118790:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00010000:00010000:3.0:1787380531.128278:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380531.232868:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380531.232967:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696128 00000100:00100000:3.0:1787380531.232977:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696128 00000100:00100000:3.0:1787380531.233046:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1787380531.233056:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:13866:x1874203915696128:12345-192.168.206.14@tcp:101:mkdir.0 00010000:00010000:3.0:1787380531.233077:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380531.233097:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6bc5 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.233160:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.233174:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.233186:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380531.233432:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787380531.233436:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380531.233532:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.233584:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 8 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.233603:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 7 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380531.233612:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:3.0:1787380531.233615:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380531.233618:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163be00, rc 0) 00000100:00100000:3.0:1787380531.234164:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+7:13866:x1874203915696128:12345-192.168.206.14@tcp:101:mkdir.0 Request processed in 1105us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380531.234174:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:2.0:1787380531.959666:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935609728:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.959743:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380531.959789:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935610240:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.959818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380531.959842:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380531.959847:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935610112:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.959868:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380531.959895:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935609856:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.959920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380531.959937:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935610368:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.959956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380531.959972:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380531.959977:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935609984:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.959996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380531.960027:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609728 00000100:00100000:2.0:1787380531.960034:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609728 00000100:00100000:2.0:1787380531.960074:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787380531.960083:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3302:x1874203935609728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960128:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3302:x1874203935609728:12345-0@lo:400:kworker.0 Request processed in 46us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380531.960135:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787380531.960165:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935610240 00000100:00100000:2.0:1787380531.960169:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935610240 00000100:00100000:2.0:1787380531.960197:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935610112 00000100:00100000:2.0:1787380531.960200:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935610112 00000100:00100000:2.0:1787380531.960210:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935610368 00000100:00100000:2.0:1787380531.960213:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935610368 00000100:00100000:2.0:1787380531.960228:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380531.960242:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935610240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960276:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935610240:12345-0@lo:400:kworker.0 Request processed in 34us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380531.960283:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380531.960297:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380531.960303:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935610112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960329:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874203935610112:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380531.960368:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380531.960382:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787380531.960388:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935610368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960420:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874203935610368:12345-0@lo:400:kworker.0 Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380531.960426:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787380531.960457:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609856 00000100:00100000:2.0:1787380531.960460:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609856 00000100:00100000:2.0:1787380531.960486:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935609984 00000100:00100000:2.0:1787380531.960488:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935609984 00000100:00100000:2.0:1787380531.960508:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380531.960515:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935609856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960545:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935609856:12345-0@lo:400:kworker.0 Request processed in 31us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380531.960552:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380531.960563:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380531.960568:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935609984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960592:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935609984:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380531.960605:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787380531.960629:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380531.960633:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380531.960636:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380531.960668:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935609984:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960677:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935609856:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960687:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3299:1874203935610368:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960718:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874203935610112:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960727:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935609728:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.960735:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935610240:0@lo:400:kworker.0 00000100:00100000:2.0:1787380531.961762:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935610496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380531.961810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380531.964514:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380531.964533:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935610624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380531.964587:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380531.974796:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935610496 00000100:00100000:0.0:1787380531.974810:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935610496 00000100:00100000:1.0:1787380531.976686:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935610624 00000100:00100000:1.0:1787380531.976698:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935610624 00000100:00100000:1.0:1787380531.976744:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380531.976754:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935610624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380531.976778:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380531.976858:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935610624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (12268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380531.976865:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380531.976908:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380531.976914:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935610496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380531.976926:0:14861:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787380531.976970:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935610496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (15160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380531.976977:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380531.979071:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935610496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380531.979122:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935610624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787380532.153248:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380533.176131:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380533.610169:0:16087:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787380534.044307:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83f5759c-3f6c-4648-962a-0ba61afad3eb 00000001:00100000:1.0:1787380534.044325:0:5808:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b07ef607-e154-4d63-8e5d-8040f62f63ba 00010000:00010000:3.0:1787380534.199851:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787380534.627233:0:6603:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83f5759c-3f6c-4648-962a-0ba61afad3eb 00010000:00010000:1.0:1787380535.230830:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787380536.116279:0:7479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83f5759c-3f6c-4648-962a-0ba61afad3eb 00000100:00100000:3.0:1787380536.181664:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380536.181707:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380536.181741:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380536.181776:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380536.181797:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380536.181815:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380536.181837:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380536.181872:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696256 00000100:00100000:3.0:1787380536.181881:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696256 00000100:00100000:3.0:1787380536.181923:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:3.0:1787380536.181932:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:2354:x1874203915696256:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380536.181991:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:2354:x1874203915696256:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.182010:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 104 00000100:00100000:3.0:1787380536.182040:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696640 00000100:00100000:3.0:1787380536.182043:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696640 00000100:00100000:3.0:1787380536.182071:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696896 00000100:00100000:3.0:1787380536.182074:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696896 00000100:00100000:3.0:1787380536.182085:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696512 00000100:00100000:3.0:1787380536.182087:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696512 00000100:00100000:3.0:1787380536.182095:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697024 00000100:00100000:3.0:1787380536.182097:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697024 00000100:00100000:3.0:1787380536.182109:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:3.0:1787380536.182115:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2354:x1874203915696640:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380536.182152:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2354:x1874203915696640:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 37us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.182160:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:3.0:1787380536.182171:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:3.0:1787380536.182177:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2354:x1874203915696896:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380536.182199:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2354:x1874203915696896:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.182205:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:3.0:1787380536.182216:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:3.0:1787380536.182222:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2354:x1874203915696512:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380536.182242:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2354:x1874203915696512:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 20us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.182247:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:3.0:1787380536.182258:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:3.0:1787380536.182270:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2354:x1874203915697024:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380536.182293:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2354:x1874203915697024:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 25us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.182299:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:3.0:1787380536.182316:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696384 00000100:00100000:3.0:1787380536.182319:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696384 00000100:00100000:2.0:1787380536.182585:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915696768 00000100:00100000:2.0:1787380536.182590:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915696768 00000100:00100000:2.0:1787380536.182613:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:2.0:1787380536.182618:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:2354:x1874203915696384:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380536.182657:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:2354:x1874203915696384:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 39us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380536.182670:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:2.0:1787380536.182681:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:2.0:1787380536.182686:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:2354:x1874203915696768:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:2.0:1787380536.182706:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:2354:x1874203915696768:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 20us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380536.182711:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00080000:2.0:1787380536.184753:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380536.184764:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380536.184768:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787380536.252324:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787380536.681185:0:16239:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff52c76d00 00000020:00000080:0.0:1787380536.681199:0:16239:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787380536.681204:0:16239:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787380536.681221:0:16239:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff52c78f90 20000000:00000080:0.0:1787380536.681230:0:16239:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d95862e7c00 uarg=0000000000000000 20000000:01000000:0.0:1787380536.681713:0:16239:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787380536.681718:0:16239:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787380536.681723:0:16239:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787380536.684673:0:16240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787380536.685150:0:16239:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787380536.700738:0:16239:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787380536.700772:0:16239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700791:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843531 expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700799:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d11884357e expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700806:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d1188435ee expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700815:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700822:0:16239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700843:0:16239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700886:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.700901:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 12 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.700914:0:16239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935610752:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380536.701010:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.701019:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 12 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.701028:0:16239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935610880:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380536.701072:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d1188435ee expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.701080:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d1188435ee expref: 18 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.701090:0:16239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935611008:0@lo:104: 00000100:00100000:0.0:1787380536.701126:0:16239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380536.701168:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d11884357e expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.701185:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d11884357e expref: 18 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.701193:0:16239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5abbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935611136:0@lo:104: 00000100:00100000:0.0:1787380536.701216:0:16239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380536.701486:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611008 00000100:00100000:1.0:1787380536.701494:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611008 00000100:00100000:1.0:1787380536.701528:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611136 00000100:00100000:1.0:1787380536.701531:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611136 00000100:00100000:1.0:1787380536.701545:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380536.701552:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+4:16239:x1874203935611008:12345-0@lo:104: 00010000:00010000:1.0:1787380536.701564:0:14204:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701611:0:14204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380536.701616:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+4:16239:x1874203935611008:12345-0@lo:104: Request processed in 65us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.701631:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380536.701647:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380536.701653:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:16239:x1874203935611136:12345-0@lo:104: 00010000:00010000:1.0:1787380536.701661:0:14204:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701694:0:14204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787380536.701698:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:16239:x1874203935611136:12345-0@lo:104: Request processed in 46us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.701704:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787380536.701720:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380536.701725:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701732:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380536.701735:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701744:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380536.701751:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380536.701756:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787380536.701781:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701788:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380536.701814:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701821:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3800/0x651a07d1188435ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d1188435f5 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701832:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380536.701835:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701841:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96c216c400 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380536.701843:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701849:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380536.701855:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380536.701860:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787380536.701874:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701879:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380536.701893:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701900:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d96c216c400/0x651a07d11884357e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118843585 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.701920:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380536.701922:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380536.701924:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380536.701937:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935611264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380536.701966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380536.702001:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935611392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380536.702025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380536.702055:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611264 00000100:00100000:1.0:1787380536.702059:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611264 00010000:00010000:1.0:1787380536.702076:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188435ee expref: 19 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380536.702095:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611392 00000100:00100000:1.0:1787380536.702097:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611392 00010000:00010000:1.0:1787380536.702106:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884357e expref: 20 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380536.702118:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380536.702124:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+20:3302:x1874203935611264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380536.702134:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380536.702139:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d1188435ee expref: 20 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.702147:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d1188435ee expref: 20 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.702163:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380536.702189:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+20:3302:x1874203935611264:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.702203:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380536.702217:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380536.702223:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3299:x1874203935611392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380536.702460:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380536.702467:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d11884357e expref: 19 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.702475:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d11884357e expref: 19 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.702486:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380536.702515:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3299:x1874203935611392:12345-0@lo:103:ldlm_bl.0 Request processed in 292us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.702522:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380536.702557:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c6627fe6-651b-4b45-bfed-0a36822f804a:3299:1874203935611392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380536.702580:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c6627fe6-651b-4b45-bfed-0a36822f804a:3302:1874203935611264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380536.702649:0:16239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x651a07d118843531 expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.702659:0:16239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x651a07d118843531 expref: 18 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.702669:0:16239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5aba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935611520:0@lo:104: 00000100:00100000:0.0:1787380536.702711:0:16239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380536.702734:0:16239:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96aaf91f00 going to sleep for 11 seconds 00010000:00010000:0.0:1787380536.702748:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96b515f200/0x651a07d1188435f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d1188435ee expref: 18 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.702758:0:16239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935611008:0@lo:104: 00010000:00010000:0.0:1787380536.702765:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2400/0x651a07d118843585 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d11884357e expref: 17 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.702771:0:16239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5abbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935611136:0@lo:104: 00000100:00100000:1.0:1787380536.702828:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787380536.702839:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611520 00000100:00100000:1.0:1787380536.702842:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611520 00000100:00100000:1.0:1787380536.702863:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380536.702869:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95858c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:16239:x1874203935611520:12345-0@lo:104: 00010000:00010000:1.0:1787380536.702878:0:14204:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.702927:0:14204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380536.702933:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95858c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c6627fe6-651b-4b45-bfed-0a36822f804a+3:16239:x1874203935611520:12345-0@lo:104: Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.702945:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787380536.702980:0:15594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380536.702984:0:15594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.702991:0:15594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3a00 already unused, calling callback (ffffffffc1db4c20) 10000000:00010000:1.0:1787380536.702994:0:15594:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.703002:0:15594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380536.703009:0:15594:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380536.703014:0:15594:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787380536.703030:0:15594:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.703037:0:15594:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380536.703214:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380536.703433:0:15594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.703441:0:15594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.114@tcp lock: ffff9d9698ff3a00/0x651a07d118843531 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x651a07d118843538 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.703453:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380536.703455:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380536.703456:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380536.703466:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935611648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380536.703504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380536.703540:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611648 00000100:00100000:1.0:1787380536.703544:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611648 00010000:00010000:1.0:1787380536.703561:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118843531 expref: 17 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380536.703579:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380536.703585:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:3300:x1874203935611648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380536.703592:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380536.703595:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x651a07d118843531 expref: 17 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.703603:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x651a07d118843531 expref: 17 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.703615:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380536.703641:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688ef1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c6627fe6-651b-4b45-bfed-0a36822f804a+17:3300:x1874203935611648:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.703647:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380536.703692:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935611648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380536.703779:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d96c216d000/0x651a07d118843538 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x651a07d118843531 expref: 16 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380536.703789:0:16239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5aba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935611520:0@lo:104: 00000100:00100000:0.0:1787380536.709105:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380536.709202:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380536.709385:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697152 00000100:00100000:1.0:1787380536.709395:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697152 00010000:00010000:1.0:1787380536.709440:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 13 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380536.709469:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697280 00000100:00100000:1.0:1787380536.709472:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697280 00010000:00010000:1.0:1787380536.709484:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 14 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380536.709513:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:1.0:1787380536.709522:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+14:2356:x1874203915697152:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380536.709536:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380536.709542:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 14 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.709553:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 14 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380536.709565:0:14206:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787380536.709574:0:14206:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787380536.709575:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380536.709627:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+14:2356:x1874203915697152:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 106us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.709635:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:1.0:1787380536.709653:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:1.0:1787380536.709659:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:2355:x1874203915697280:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380536.710157:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968163b600/0x651a07d118843817 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b9b expref: 13 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380536.710171:0:16239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587463800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935610752:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380536.710181:0:16239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587461f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16239:1874203935610880:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380536.710213:0:16239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710480:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380536.710487:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 12 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710499:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 12 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710512:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d9698ff2800/0x651a07d1188437df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b39 expref: 12 pid: 14215 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710523:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710539:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710553:0:14208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710559:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710566:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710573:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710578:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55400 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380536.710582:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.710589:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.711605:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380536.711627:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380536.711764:0:16239:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.711773:0:16239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.711780:0:16239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d968af55400/0x651a07d118843841 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380536.711816:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:2355:x1874203915697280:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 2153us (2611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.711827:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:2.0:1787380537.080300:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935612032:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.080384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380537.080627:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380537.080635:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935612160:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.080666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380537.080697:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612032 00000100:00100000:2.0:1787380537.080703:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612032 00000100:00100000:2.0:1787380537.080754:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380537.080763:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935612032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.080816:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935612032:12345-0@lo:400:kworker.0 Request processed in 54us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.080824:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380537.080847:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612160 00000100:00100000:2.0:1787380537.080850:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612160 00000100:00100000:2.0:1787380537.080893:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787380537.080898:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935612160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.080929:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874203935612160:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.080936:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787380537.080952:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380537.080978:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874203935612160:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.080989:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935612032:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.081043:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935611904:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.081068:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380537.081093:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935612416:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.081112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380537.082389:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787380537.082402:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935611776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380537.082463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380537.082544:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96892eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935612288:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.082569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380537.082598:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611904 00000100:00100000:2.0:1787380537.082603:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611904 00000100:00100000:2.0:1787380537.082646:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380537.082653:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935611904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.082703:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935611904:12345-0@lo:400:kworker.0 Request processed in 50us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.082710:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380537.082729:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612416 00000100:00100000:2.0:1787380537.082742:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612416 00000100:00100000:2.0:1787380537.082765:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612288 00000100:00100000:2.0:1787380537.082768:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612288 00000100:00100000:2.0:1787380537.082783:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380537.082789:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96892ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935612416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.082819:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96892ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935612416:12345-0@lo:400:kworker.0 Request processed in 30us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.082825:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380537.082836:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380537.082842:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935612288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.082866:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935612288:12345-0@lo:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.082871:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787380537.082889:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380537.082892:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380537.082925:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935612288:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.082938:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935611904:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.082946:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935612416:0@lo:400:kworker.0 00000100:00100000:2.0:1787380537.084114:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935612544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380537.084160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380537.085822:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935611776 00000100:00100000:3.0:1787380537.085833:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935611776 00000100:00100000:3.0:1787380537.086104:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612544 00000100:00100000:3.0:1787380537.086108:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612544 00000100:00100000:3.0:1787380537.086128:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380537.086137:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935611776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380537.086170:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380537.086231:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874203935611776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380537.086239:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380537.086254:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380537.086260:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935612544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787380537.086284:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787380537.086316:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1874203935612544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (2156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380537.086323:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380537.086385:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96892ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3302:1874203935611776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380537.086438:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3299:1874203935612544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787380537.271597:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380538.048322:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380538.048522:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697408 00000100:00100000:2.0:1787380538.048532:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697408 00000100:00100000:2.0:1787380538.048584:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 105 00000100:00100000:2.0:1787380538.048595:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+11:13721:x1874203915697408:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380538.048610:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.048643:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff3400/0x651a07d118843848 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6bcc expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.048672:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff3400/0x651a07d118843848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bcc expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.048683:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff3400/0x651a07d118843848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bcc expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.048692:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3400, rc 0) 00000100:00100000:2.0:1787380538.048755:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13721:x1874203915697408:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 162us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.048762:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 105 00000100:00100000:1.0:1787380538.071421:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380538.071514:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697536 00000100:00100000:2.0:1787380538.071524:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697536 00000100:00100000:2.0:1787380538.071582:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 106 00000100:00100000:2.0:1787380538.071592:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13721:x1874203915697536:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380538.071876:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13721:x1874203915697536:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 283us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.071884:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 106 00000100:00100000:1.0:1787380538.074156:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380538.074224:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697664 00000100:00100000:3.0:1787380538.074233:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697664 00000100:00100000:3.0:1787380538.074291:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 107 00000100:00100000:3.0:1787380538.074301:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13721:x1874203915697664:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380538.074541:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13721:x1874203915697664:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 241us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.074551:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 107 00000100:00100000:1.0:1787380538.079640:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380538.079933:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697792 00000100:00100000:3.0:1787380538.079944:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697792 00000100:00100000:3.0:1787380538.080000:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 108 00000100:00100000:3.0:1787380538.080010:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+12:13721:x1874203915697792:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380538.080038:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380538.080057:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b600/0x651a07d11884384f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6bd3 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.080085:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b600/0x651a07d11884384f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bd3 expref: 13 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.080097:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b600/0x651a07d11884384f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bd3 expref: 13 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.080118:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b600, rc 0) 00000100:00100000:3.0:1787380538.080176:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13721:x1874203915697792:12345-192.168.206.14@tcp:101:ll_cfg_requeue.0 Request processed in 166us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.080183:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 108 00000100:00100000:3.0:1787380538.093506:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380538.093544:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915697920 00000100:00100000:3.0:1787380538.093553:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915697920 00000100:00100000:3.0:1787380538.093597:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 109 00000100:00100000:3.0:1787380538.093606:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13721:x1874203915697920:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380538.093864:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13721:x1874203915697920:12345-192.168.206.14@tcp:501:ll_cfg_requeue.0 Request processed in 259us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.093872:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 109 00000100:00100000:3.0:1787380538.095850:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380538.095876:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915698048 00000100:00100000:3.0:1787380538.095885:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915698048 00000100:00100000:3.0:1787380538.095925:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 110 00000100:00100000:3.0:1787380538.095934:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13721:x1874203915698048:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380538.096144:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:13721:x1874203915698048:12345-192.168.206.14@tcp:503:ll_cfg_requeue.0 Request processed in 209us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.096152:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 110 10000000:01000000:3.0:1787380538.295859:0:14218:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380538.295867:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96aaef6000 from 10 10000000:01000000:3.0:1787380538.295872:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380538.295919:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118843856 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.295948:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118843856 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.295960:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118843856 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.295985:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585eab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935612672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380538.296048:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380538.296098:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9688e5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380538.296154:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612672 00000100:00100000:0.0:1787380538.296162:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612672 00000100:00100000:0.0:1787380538.296213:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787380538.296222:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+16:14218:x1874203935612672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380538.296244:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380538.296257:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968af55800/0x651a07d11884385d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843856 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.296278:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968af55800/0x651a07d11884385d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843856 expref: 17 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.296289:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968af55800/0x651a07d11884385d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843856 expref: 17 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.296298:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55800, rc 0) 00000100:00100000:0.0:1787380538.296374:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+17:14218:x1874203935612672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380538.296381:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787380538.296766:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585eab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935612672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380538.296781:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118843856 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884385d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.296790:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118843856 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884385d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.296843:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935612800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380538.296879:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380538.296991:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968b596600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380538.297171:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612800 00000100:00100000:1.0:1787380538.297176:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612800 00000100:00100000:1.0:1787380538.297212:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787380538.297219:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d958498f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+17:14218:x1874203935612800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380538.298466:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935612800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380538.298596:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935612928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380538.298642:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380538.298683:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968b596600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.298889:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935612928 00000100:00100000:3.0:1787380538.298896:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935612928 00000100:00100000:3.0:1787380538.298938:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787380538.298947:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935612928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380538.299106:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935612928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.299115:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787380538.299212:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d958498f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+17:14218:x1874203935612800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 827us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380538.299220:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787380538.299333:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935612928:0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1787380538.299757:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787380538.301195:0:16320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787380538.301956:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787380538.301984:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380538.301995:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118843856 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884385d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.302007:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d968163a800/0x651a07d118843856 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884385d expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380538.302017:0:14218:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380538.302019:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96bd215800 from 10 10000000:01000000:1.0:1787380538.302022:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380538.302058:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f200/0x651a07d118843864 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.302067:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96b515f200/0x651a07d118843864 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.302077:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96b515f200/0x651a07d118843864 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.302117:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.302179:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.302261:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.302478:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935613056 00000100:00100000:3.0:1787380538.302486:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935613056 00000100:00100000:3.0:1787380538.302700:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787380538.302710:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+17:14218:x1874203935613056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380538.302723:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380538.302735:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d968163b400/0x651a07d11884386b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843864 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.302759:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d968163b400/0x651a07d11884386b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843864 expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.302783:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d968163b400/0x651a07d11884386b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843864 expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.302800:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b400, rc 0) 00000100:00100000:3.0:1787380538.302856:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935613056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.302863:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787380538.302941:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380538.302955:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96b515f200/0x651a07d118843864 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884386b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.302964:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96b515f200/0x651a07d118843864 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d11884386b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.303015:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.303044:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.304974:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380538.305096:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935613184 00000100:00100000:2.0:1787380538.305104:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935613184 00000100:00100000:2.0:1787380538.305147:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787380538.305155:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935613184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380538.305482:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935613184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.305490:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787380538.305663:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.305708:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.305755:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.305765:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380538.305810:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935613312 00000100:00100000:2.0:1787380538.305815:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935613312 00000100:00100000:2.0:1787380538.305834:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787380538.305840:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935613312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380538.305982:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935613312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.305989:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787380538.306067:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787380538.307083:0:16321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787380538.307570:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787380538.307589:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380538.307599:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515f200/0x651a07d118843864 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884386b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.307610:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515f200/0x651a07d118843864 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d11884386b expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380538.307631:0:14218:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380538.307633:0:14218:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d96bcdf7800 from 10 10000000:01000000:1.0:1787380538.307636:0:14218:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380538.307662:0:14218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515e200/0x651a07d118843872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.307670:0:14218:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.114@tcp lock: ffff9d96b515e200/0x651a07d118843872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.307678:0:14218:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.114@tcp lock: ffff9d96b515e200/0x651a07d118843872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.307695:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.307738:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.307805:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380538.307837:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935613440 00000100:00100000:2.0:1787380538.307844:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935613440 00000100:00100000:2.0:1787380538.307912:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787380538.307926:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+18:14218:x1874203935613440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380538.307937:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.307948:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d9698ff3000/0x651a07d118843879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x651a07d118843872 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.307968:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d9698ff3000/0x651a07d118843879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x651a07d118843872 expref: 19 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.307976:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d9698ff3000/0x651a07d118843879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x651a07d118843872 expref: 19 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.307983:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3000, rc 0) 00000100:00100000:2.0:1787380538.308022:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935613440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.308029:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787380538.308088:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380538.308101:0:14218:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.114@tcp lock: ffff9d96b515e200/0x651a07d118843872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843879 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.308109:0:14218:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.114@tcp lock: ffff9d96b515e200/0x651a07d118843872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x651a07d118843879 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.308151:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.308191:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.311752:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.311929:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935613568 00000100:00100000:3.0:1787380538.311938:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935613568 00000100:00100000:3.0:1787380538.311985:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787380538.311994:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935613568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380538.312819:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935613568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 823us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.312829:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787380538.312916:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.312964:0:14218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380538.313013:0:14218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.313042:0:14218:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.313080:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935613696 00000100:00100000:3.0:1787380538.313085:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935613696 00000100:00100000:3.0:1787380538.313106:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787380538.313112:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935613696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380538.313398:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c6627fe6-651b-4b45-bfed-0a36822f804a+19:14218:x1874203935613696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 285us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.313405:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787380538.313489:0:14218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5114e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c6627fe6-651b-4b45-bfed-0a36822f804a:14218:1874203935613696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787380538.314715:0:16322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787380538.315037:0:14218:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787380538.315056:0:14218:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.114@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380538.315066:0:14218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.114@tcp lock: ffff9d96b515e200/0x651a07d118843872 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843879 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.315096:0:14218:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.114@tcp lock: ffff9d96b515e200/0x651a07d118843872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x651a07d118843879 expref: -99 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380538.808008:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787380539.319945:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380539.789094:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380539.789224:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915698176 00000100:00100000:2.0:1787380539.789233:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915698176 00000100:00100000:2.0:1787380539.789388:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:2.0:1787380539.789399:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:14375:x1874203915698176:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380539.789432:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380539.789456:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6bda expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.789693:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.789708:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.789738:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.789754:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.789761:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.789767:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790226:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2000/0x651a07d118843895 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790236:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2000/0x651a07d118843895 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790244:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2000/0x651a07d118843895 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380539.790328:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787380539.790332:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380539.790463:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2000/0x651a07d118843895 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790474:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790480:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790495:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790501:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380539.790505:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790513:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790773:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:2.0:1787380539.790778:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380539.790784:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790792:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d118843887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790806:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790812:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790817:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790822:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380539.790824:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790841:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790850:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d969371a100) 00010000:00010000:2.0:1787380539.790852:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380539.790855:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790861:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884388e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790898:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bda expref: 8 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790910:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2000/0x651a07d118843895 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bda expref: 7 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.790917:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d969371a700) 00010000:00010000:2.0:1787380539.790919:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380539.790921:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2000, rc 0) 00000100:00100000:2.0:1787380539.791053:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:14375:x1874203915698176:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 1656us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.791063:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00080000:0.0:1787380539.792133:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380539.800071:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380539.801504:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915698432 00000100:00100000:2.0:1787380539.801529:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915698432 00000100:00100000:2.0:1787380539.801610:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:2.0:1787380539.801620:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:14375:x1874203915698432:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380539.801658:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380539.801677:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884389c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6be1 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.801771:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.801785:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.801795:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.801868:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.801875:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.801882:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.802664:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d1188438b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.802675:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d1188438b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.802698:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d1188438b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380539.802709:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787380539.804307:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804322:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804329:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804436:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380539.804442:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804450:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804466:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d969371a700) 00010000:00010000:2.0:1787380539.804469:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380539.804473:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804479:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804493:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804499:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804504:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804524:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380539.804527:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804533:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804543:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d969371a100) 00010000:00010000:2.0:1787380539.804545:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380539.804548:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804553:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.804987:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884389c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6be1 expref: 10 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.805003:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2c00/0x651a07d1188438b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6be1 expref: 9 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.805010:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d969371ae00) 00010000:00010000:2.0:1787380539.805012:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380539.805015:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2c00, rc 0) 00000100:00100000:2.0:1787380539.805094:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14375:x1874203915698432:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 3475us (5031us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787380539.805104:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:1.0:1787380539.811586:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380539.811681:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915698560 00000100:00100000:3.0:1787380539.811691:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915698560 00000100:00100000:3.0:1787380539.811752:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:3.0:1787380539.811762:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14375:x1874203915698560:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787380539.811885:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14375:x1874203915698560:12345-192.168.206.14@tcp:59:lhsmtool_posix.0 Request processed in 123us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.811894:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000040:00080000:1.0:1787380539.832141:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787380539.859759:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380539.859832:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915698688 00000100:00100000:2.0:1787380539.859854:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915698688 00000100:00100000:0.0:1787380539.860069:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:0.0:1787380539.860081:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14381:x1874203915698688:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380539.860100:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380539.860132:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54200/0x651a07d1188438bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6be8 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860192:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860205:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860226:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860240:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860247:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860252:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380539.860788:0:14221:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787380539.860798:0:14221:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:0.0:1787380539.860878:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860887:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860894:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.860911:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380539.861196:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861264:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861282:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:0.0:1787380539.861285:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380539.861290:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861297:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d1188438c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861310:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861617:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861625:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861630:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54a00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:0.0:1787380539.861633:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861640:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861659:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d96897d4a00) 00010000:00010000:0.0:1787380539.861662:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380539.861665:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861671:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861711:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54200/0x651a07d1188438bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6be8 expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861721:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:0.0:1787380539.861723:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380539.861727:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54200/0x651a07d1188438bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6be8 expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.861734:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54200, rc 0) 00000100:00100000:0.0:1787380539.863880:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14381:x1874203915698688:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 3792us (4119us total) trans 0 rc 301/301 00000100:00100000:0.0:1787380539.863891:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 18 00000100:00100000:1.0:1787380539.870763:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380539.873592:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915698816 00000100:00100000:2.0:1787380539.873605:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915698816 00000100:00100000:2.0:1787380539.873669:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:2.0:1787380539.873680:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14381:x1874203915698816:12345-192.168.206.14@tcp:700:lfs.0 00000100:00100000:2.0:1787380539.873760:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14381:x1874203915698816:12345-192.168.206.14@tcp:700:lfs.0 Request processed in 82us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.873767:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1787380539.877145:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380539.877400:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915699072 00000100:00100000:3.0:1787380539.877420:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915699072 00000100:00100000:3.0:1787380539.877486:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 19 00000100:00100000:3.0:1787380539.877497:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14381:x1874203915699072:12345-192.168.206.14@tcp:36:lfs.0 00010000:00010000:3.0:1787380539.877550:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380539.877576:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55a00/0x651a07d118843802 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6b63 expref: 9 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.877595:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:3.0:1787380539.877600:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380539.877871:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.877884:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 5 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.877903:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.877936:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 5 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.877961:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 5 pid: 14221 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380539.877975:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9585ea8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935613824:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380539.878076:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9688e5c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380539.880784:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9585ea8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935613824:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380539.880808:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380539.881162:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380539.881252:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915699200 00000100:00100000:2.0:1787380539.881259:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915699200 00010000:00010000:2.0:1787380539.881315:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 6 pid: 14221 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380539.881395:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:2.0:1787380539.881414:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:2355:x1874203915699200:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380539.881434:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380539.881441:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 6 pid: 14221 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.881454:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 6 pid: 14221 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.881480:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d11884383a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bc5 expref: 6 pid: 14221 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.881498:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:2.0:1787380539.881515:0:14206:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.881525:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.881531:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.881551:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380539.881595:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2355:x1874203915699200:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 192us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.881602:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00080000:0.0:1787380539.881676:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787380539.882008:0:14222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.882017:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.882040:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.882049:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.882057:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380539.883564:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787380539.883579:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.883596:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.883603:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.883610:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380539.883614:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.883621:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.883637:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4500) 00010000:00010000:1.0:1787380539.883640:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380539.883644:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.883650:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d1188438d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380539.883670:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009aa02cae reply state 00000000b8247b5d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380539.883679:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380539.883775:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+10:14381:x1874203915699072:12345-192.168.206.14@tcp:36:lfs.0 Request processed in 6277us (6636us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787380539.883784:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 19 00010000:00010000:2.0:1787380539.888571:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.888589:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.888597:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.888604:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380539.888608:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.888626:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.888642:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d968911d500) 00010000:00010000:2.0:1787380539.888645:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380539.888663:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.888670:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d1188438db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380539.960027:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380539.960185:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915699328 00000100:00100000:0.0:1787380539.960195:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915699328 00000100:00100000:0.0:1787380539.960247:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:0.0:1787380539.960257:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:14389:x1874203915699328:12345-192.168.206.14@tcp:101:lctl.0 00010000:00010000:0.0:1787380539.960281:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380539.960302:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54200/0x651a07d1188438e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6bef expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.960397:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.960423:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.960434:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380539.960491:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787380539.960495:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380539.960759:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.960784:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54200/0x651a07d1188438e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bef expref: 11 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.960801:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54a00/0x651a07d1188438e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bef expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380539.960811:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:0.0:1787380539.960813:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380539.960817:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54a00, rc 0) 00000100:00100000:0.0:1787380539.961054:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+10:14389:x1874203915699328:12345-192.168.206.14@tcp:101:lctl.0 Request processed in 798us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380539.961063:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 20 00000100:00100000:1.0:1787380539.995971:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380539.996070:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915699456 00000100:00100000:2.0:1787380539.996080:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915699456 00000100:00100000:2.0:1787380539.996136:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:2.0:1787380539.996146:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:14390:x1874203915699456:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380539.996167:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380539.996187:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d1188438f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6bf6 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.996246:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.996258:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.996270:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380539.996325:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787380539.996333:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380539.996720:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.996746:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d1188438f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bf6 expref: 7 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.996767:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2800/0x651a07d1188438f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bf6 expref: 6 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380539.996775:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:3.0:1787380539.996778:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380539.996792:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2800, rc 0) 00000100:00100000:3.0:1787380539.996902:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:14390:x1874203915699456:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 757us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.996911:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 21 00000100:00100000:3.0:1787380540.006442:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380540.006544:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915699584 00000100:00100000:2.0:1787380540.006554:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915699584 00000100:00100000:2.0:1787380540.006619:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:2.0:1787380540.006629:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+6:14390:x1874203915699584:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380540.006649:0:16354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380540.006678:0:16354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6bfd expref: -99 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.006740:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.006753:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.006764:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.006778:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.006784:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.006791:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.006998:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843913 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007006:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007012:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380540.007052:0:16354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787380540.007056:0:16354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380540.007078:0:16354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007099:0:16354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007105:0:16354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007110:0:16354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007115:0:16354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3a00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380540.007119:0:16354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007126:0:16354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007138:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:2.0:1787380540.007141:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380540.007145:0:16354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007150:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d118843905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007162:0:16354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007169:0:16354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007175:0:16354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007186:0:16354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380540.007189:0:16354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007195:0:16354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007204:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d969371a100) 00010000:00010000:2.0:1787380540.007206:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380540.007209:0:16354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007216:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d11884390c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007251:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d1188438fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bfd expref: 8 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007264:0:16354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843913 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bfd expref: 7 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.007271:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371ab00) 00010000:00010000:2.0:1787380540.007273:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380540.007275:0:16354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2400, rc 0) 00000100:00100000:2.0:1787380540.007381:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+7:14390:x1874203915699584:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 711us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380540.007389:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:1.0:1787380540.014214:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380540.014300:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915699840 00000100:00100000:3.0:1787380540.014310:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915699840 00000100:00100000:3.0:1787380540.014387:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:3.0:1787380540.014396:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+7:14390:x1874203915699840:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380540.014429:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380540.014447:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d11884391a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c04 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380540.014554:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787380540.014680:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d11884391a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c04 expref: 9 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.014694:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:3.0:1787380540.014697:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380540.014702:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d11884391a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c04 expref: 9 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.014715:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b000, rc 0) 00000100:00100000:3.0:1787380540.014775:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+8:14390:x1874203915699840:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 379us (570us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787380540.014783:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 23 00000100:00100000:1.0:1787380540.019327:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380540.019470:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915700096 00000100:00100000:2.0:1787380540.019493:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915700096 00000100:00100000:2.0:1787380540.019551:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 24 00000100:00100000:2.0:1787380540.019560:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9698da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+8:14390:x1874203915700096:12345-192.168.206.14@tcp:36:lfs.0 00010000:00010000:2.0:1787380540.019635:0:16354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380540.019660:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843913 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6bfd expref: 8 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.019678:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371ab00) 00010000:00010000:2.0:1787380540.019699:0:16354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380540.019725:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.019737:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.019745:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380540.019974:0:16354:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2d310d4 reply state 00000000893453da transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380540.019984:0:16354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787380540.019998:0:16354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787380540.020089:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9698da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+9:14390:x1874203915700096:12345-192.168.206.14@tcp:36:lfs.0 Request processed in 529us (770us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787380540.020097:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 24 00010000:00010000:2.0:1787380540.024588:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.024606:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.024631:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.024637:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380540.024642:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.024650:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.024667:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:2.0:1787380540.024669:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787380540.024674:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.024680:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843928 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380540.027951:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.028047:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915700352 00000100:00100000:0.0:1787380540.028057:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915700352 00000100:00100000:0.0:1787380540.028121:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:0.0:1787380540.028131:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+8:14390:x1874203915700352:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380540.028395:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+9:14390:x1874203915700352:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 265us (453us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787380540.028416:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:1.0:1787380540.031162:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380540.031288:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915700608 00000100:00100000:3.0:1787380540.031297:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915700608 00000100:00100000:3.0:1787380540.031388:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:3.0:1787380540.031398:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+9:14390:x1874203915700608:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380540.031429:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380540.031447:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d11884392f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c0b expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031511:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031525:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031536:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031550:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031558:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031564:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380540.031697:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787380540.031782:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031790:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031796:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031808:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163be00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380540.031813:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031820:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031832:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:3.0:1787380540.031835:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380540.031850:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031856:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031870:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031876:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031882:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031887:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380540.031889:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031895:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031914:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d968727fb00) 00010000:00010000:3.0:1787380540.031916:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380540.031919:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031926:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d11884393d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031968:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d11884392f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c0b expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031979:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:3.0:1787380540.031981:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380540.031985:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d11884392f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c0b expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.031995:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163b000, rc 0) 00000100:00100000:3.0:1787380540.032059:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+10:14390:x1874203915700608:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 662us (905us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787380540.032068:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 25 00000100:00100000:1.0:1787380540.037188:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380540.038131:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915700736 00000100:00100000:2.0:1787380540.038142:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915700736 00000100:00100000:2.0:1787380540.038288:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:2.0:1787380540.038299:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+10:14390:x1874203915700736:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380540.038321:0:16354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380540.038364:0:16354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884394b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c12 expref: -99 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.038456:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.038469:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.038493:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380540.038540:0:16354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787380540.038544:0:16354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380540.038565:0:16354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.040078:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d11884394b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 12 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.040100:0:16354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 11 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.040109:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:2.0:1787380540.040112:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380540.040115:0:16354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2400, rc 0) 00000100:00100000:2.0:1787380540.040198:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+11:14390:x1874203915700736:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 1899us (3018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380540.040207:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 26 00000100:00100000:1.0:1787380540.054015:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.054110:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915700864 00000100:00100000:0.0:1787380540.054120:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915700864 00000100:00100000:0.0:1787380540.054191:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:0.0:1787380540.054201:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+11:14390:x1874203915700864:12345-192.168.206.14@tcp:37:lfs.0 00000100:00100000:0.0:1787380540.062386:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+11:14390:x1874203915700864:12345-192.168.206.14@tcp:37:lfs.0 Request processed in 8176us (8370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380540.062411:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 3 00000100:00100000:1.0:1787380540.065393:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380540.065511:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915701120 00000100:00100000:2.0:1787380540.065519:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915701120 00000100:00100000:2.0:1787380540.065569:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:2.0:1787380540.065578:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5b04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+11:14390:x1874203915701120:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:2.0:1787380540.066117:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5b04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+12:14390:x1874203915701120:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 537us (729us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787380540.066125:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 4 00000100:00100000:1.0:1787380540.111215:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380540.111414:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915701248 00000100:00100000:3.0:1787380540.111424:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915701248 00000100:00100000:3.0:1787380540.111481:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:3.0:1787380540.111492:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+10:14396:x1874203915701248:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380540.111512:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380540.111531:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c19 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111636:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111650:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111661:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111853:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111863:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111871:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111981:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d11884396e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111990:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d11884396e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.111997:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d11884396e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380540.112025:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787380540.112028:0:14222:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380540.112066:0:14222:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d11884396e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112482:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112491:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112497:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112502:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380540.112506:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112513:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112525:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:3.0:1787380540.112528:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380540.112532:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112538:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112662:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112670:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112906:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.112920:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163be00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380540.112923:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.113211:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.113222:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d968727fb00) 00010000:00010000:3.0:1787380540.113224:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380540.113228:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.113233:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843967 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.113275:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c19 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.113287:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163ba00/0x651a07d11884396e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c19 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.113294:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:3.0:1787380540.113296:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787380540.113299:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163ba00, rc 0) 00000100:00100000:3.0:1787380540.115437:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+11:14396:x1874203915701248:12345-192.168.206.14@tcp:101:bash.0 Request processed in 3935us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380540.115452:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 27 00000100:00100000:1.0:1787380540.122835:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.123241:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915701504 00000100:00100000:0.0:1787380540.123252:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915701504 00000100:00100000:0.0:1787380540.123516:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 28 00000100:00100000:0.0:1787380540.123528:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+11:14396:x1874203915701504:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:0.0:1787380540.123548:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380540.123568:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54200/0x651a07d118843975 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c20 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.123714:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.123729:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 11 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.123737:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.123782:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 11 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.123795:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 11 pid: 16354 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380540.123808:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14223:1874203935613952:192.168.206.14@tcp:104: 00000100:00100000:0.0:1787380540.123890:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96a03dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380540.131782:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5ab9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14223:1874203935613952:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380540.131819:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380540.134056:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.137702:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915701632 00000100:00100000:0.0:1787380540.137716:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915701632 00010000:00010000:0.0:1787380540.137759:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 12 pid: 16354 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380540.137852:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:0.0:1787380540.137862:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+12:2354:x1874203915701632:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380540.137876:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380540.137883:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 12 pid: 16354 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.137896:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 12 pid: 16354 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.137947:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843952 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c12 expref: 12 pid: 16354 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.137963:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:0.0:1787380540.137969:0:14207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.137978:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.137986:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.138017:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380540.138078:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83f5759c-3f6c-4648-962a-0ba61afad3eb+11:2354:x1874203915701632:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 217us (4031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380540.138095:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00010000:00010000:2.0:1787380540.138157:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.138166:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.138187:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.138197:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.138205:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139012:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139022:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139030:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380540.139042:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787380540.139068:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139076:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139082:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139100:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af55200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380540.139104:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139112:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139123:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:2.0:1787380540.139126:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380540.139130:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139135:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55200/0x651a07d11884397c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380540.139147:0:14223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb3b8654 reply state 00000000ba1a04d7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380540.139155:0:14223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787380540.139187:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54200/0x651a07d118843975 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 14 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139200:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 13 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.139206:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380540.139209:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787380540.139211:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3a00, rc 0) 00000100:00100000:2.0:1787380540.139255:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+14:14396:x1874203915701504:12345-192.168.206.14@tcp:101:bash.0 Request processed in 15729us (16429us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787380540.139269:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 28 00010000:00010000:3.0:1787380540.143812:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.156025:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.156036:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.156043:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380540.156048:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.156057:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.156075:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d969371ab00) 00010000:00010000:3.0:1787380540.156078:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380540.156096:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.156104:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843983 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380540.163583:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.163669:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915701760 00000100:00100000:0.0:1787380540.163679:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915701760 00000100:00100000:0.0:1787380540.163737:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:0.0:1787380540.163747:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9585eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+13:14396:x1874203915701760:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:0.0:1787380540.163770:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380540.163789:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54400/0x651a07d118843998 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c27 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.163852:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55000/0x651a07d11884399f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.163881:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55000/0x651a07d11884399f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.163892:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55000/0x651a07d11884399f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380540.163931:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787380540.163935:0:14221:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787380540.163955:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55000/0x651a07d11884399f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.163966:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55000/0x651a07d11884399f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.163990:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54400/0x651a07d118843998 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c27 expref: 15 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.164007:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55000/0x651a07d11884399f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c27 expref: 14 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.164015:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:0.0:1787380540.164018:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380540.164021:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af55000, rc 0) 00000100:00100000:0.0:1787380540.164075:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9585eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+14:14396:x1874203915701760:12345-192.168.206.14@tcp:101:bash.0 Request processed in 329us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380540.164099:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 29 00000100:00100000:2.0:1787380540.171476:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.171556:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915702016 00000100:00100000:0.0:1787380540.171566:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915702016 00000100:00100000:0.0:1787380540.171633:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:0.0:1787380540.171657:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+14:14396:x1874203915702016:12345-192.168.206.14@tcp:35:bash.0 00000100:00100000:0.0:1787380540.171997:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+15:14396:x1874203915702016:12345-192.168.206.14@tcp:35:bash.0 Request processed in 340us (528us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787380540.172006:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 5 00000100:00100000:0.0:1787380540.244077:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380540.245252:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915702272 00000100:00100000:2.0:1787380540.245265:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915702272 00000100:00100000:2.0:1787380540.245320:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:2.0:1787380540.245331:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+15:14406:x1874203915702272:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:2.0:1787380540.245385:0:16354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380540.245415:0:16354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c2e expref: -99 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380540.245541:0:16354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787380540.245657:0:16354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c2e expref: 17 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.245672:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:2.0:1787380540.245676:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380540.245682:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c2e expref: 17 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.245696:0:16354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3e00, rc 0) 00000100:00100000:2.0:1787380540.245774:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+16:14406:x1874203915702272:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 444us (1706us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787380540.245781:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 30 00000100:00100000:2.0:1787380540.248377:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.248466:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915702528 00000100:00100000:0.0:1787380540.248477:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915702528 00000100:00100000:0.0:1787380540.248529:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:0.0:1787380540.248538:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+16:14406:x1874203915702528:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:0.0:1787380540.248937:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+17:14406:x1874203915702528:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 397us (599us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787380540.248946:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 6 00000100:00100000:1.0:1787380540.281924:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.282071:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915702784 00000100:00100000:0.0:1787380540.282081:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915702784 00000100:00100000:0.0:1787380540.282139:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:0.0:1787380540.282149:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+17:14409:x1874203915702784:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:0.0:1787380540.282174:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380540.282193:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54400/0x651a07d1188439b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c35 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.282292:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188439bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.282305:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188439bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.282315:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188439bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380540.282545:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787380540.282855:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54400/0x651a07d1188439b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c35 expref: 20 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.282874:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188439bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c35 expref: 19 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380540.282882:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:0.0:1787380540.282884:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380540.282888:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968af54800, rc 0) 00000100:00100000:0.0:1787380540.283001:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+19:14409:x1874203915702784:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 852us (1085us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787380540.283008:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 31 00000100:00100000:0.0:1787380540.287100:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380540.287194:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380540.287277:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915703040 00000100:00100000:1.0:1787380540.287287:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915703040 00000100:00100000:1.0:1787380540.287383:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1787380540.287394:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+19:2353:x1874203915703040:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380540.287419:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380540.287445:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54800/0x651a07d1188439bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c35 expref: 19 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380540.287462:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380540.287467:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380540.287517:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+18:2353:x1874203915703040:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 125us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380540.287525:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:2.0:1787380540.289105:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915702912 00000100:00100000:2.0:1787380540.289116:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915702912 00000100:00100000:2.0:1787380540.289187:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:2.0:1787380540.289196:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+18:14409:x1874203915702912:12345-192.168.206.14@tcp:54:lfs.0 00010000:00010000:2.0:1787380540.289259:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289274:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289285:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289312:0:16354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289319:0:16354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289324:0:16354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289330:0:16354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3e00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380540.289334:0:16354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289370:0:16354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289381:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380540.289385:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380540.289389:0:16354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.289417:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380540.289496:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+18:14409:x1874203915702912:12345-192.168.206.14@tcp:54:lfs.0 Request processed in 300us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380540.289504:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 32 00000100:00100000:0.0:1787380540.292957:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380540.293279:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915703296 00000100:00100000:1.0:1787380540.293288:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915703296 00000100:00100000:1.0:1787380540.293508:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 7 00000100:00100000:1.0:1787380540.293520:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+18:14409:x1874203915703296:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380540.293759:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+19:14409:x1874203915703296:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 241us (808us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787380540.298594:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 7 00010000:00010000:2.0:1787380540.344505:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380540.591635:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380540.591738:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915703552 00000100:00100000:1.0:1787380540.591747:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915703552 00000100:00100000:1.0:1787380540.591804:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:1.0:1787380540.591814:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+19:14440:x1874203915703552:12345-192.168.206.14@tcp:101:cat.0 00010000:00010000:1.0:1787380540.591848:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380540.591868:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188439d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c3c expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380540.591973:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188439d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380540.591987:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188439d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380540.591997:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188439d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380540.592008:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787380540.592139:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d1188439d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c3c expref: 22 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380540.592160:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188439d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c3c expref: 21 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380540.592167:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380540.592182:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380540.592186:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fe00, rc 0) 00000100:00100000:1.0:1787380540.592246:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+21:14440:x1874203915703552:12345-192.168.206.14@tcp:101:cat.0 Request processed in 433us (620us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787380540.592252:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 33 00000100:00100000:2.0:1787380540.595460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380540.595557:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915703680 00000100:00100000:1.0:1787380540.595571:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915703680 00000100:00100000:1.0:1787380540.595649:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:1.0:1787380540.595659:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+21:2354:x1874203915703680:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380540.595675:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380540.595698:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d1188439d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c3c expref: 21 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380540.595715:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380540.595719:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380540.595772:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+20:2354:x1874203915703680:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380540.595780:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 1 00000100:00100000:0.0:1787380540.597513:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380540.597582:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915703936 00000100:00100000:2.0:1787380540.597590:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915703936 00000100:00100000:2.0:1787380540.597689:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:2.0:1787380540.597699:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+20:14440:x1874203915703936:12345-192.168.206.14@tcp:35:cat.0 00000100:00100000:2.0:1787380540.598232:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+21:14440:x1874203915703936:12345-192.168.206.14@tcp:35:cat.0 Request processed in 532us (724us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787380540.598241:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 8 00000100:00100000:3.0:1787380540.698588:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380540.698817:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915704192 00000100:00100000:2.0:1787380540.698828:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915704192 00000100:00100000:2.0:1787380540.698887:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:2.0:1787380540.698897:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+21:14446:x1874203915704192:12345-192.168.206.14@tcp:101:dd.0 00010000:00010000:2.0:1787380540.698921:0:16354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380540.698940:0:16354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439e5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c43 expref: -99 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.699043:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d1188439ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.699058:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d1188439ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.699096:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d1188439ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380540.699109:0:16354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787380540.699254:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d1188439e5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c43 expref: 24 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.699277:0:16354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d1188439ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c43 expref: 23 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.699286:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380540.699288:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380540.699292:0:16354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2400, rc 0) 00000100:00100000:2.0:1787380540.699682:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+23:14446:x1874203915704192:12345-192.168.206.14@tcp:101:dd.0 Request processed in 784us (1100us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787380540.699690:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 34 00000100:00100000:0.0:1787380540.713724:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380540.713859:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915704448 00000100:00100000:3.0:1787380540.713870:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915704448 00000100:00100000:3.0:1787380540.713941:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 35 00000100:00100000:3.0:1787380540.713952:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+23:14446:x1874203915704448:12345-192.168.206.14@tcp:36:dd.0 00010000:00010000:3.0:1787380540.714007:0:14221:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787380540.714046:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d1188439ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c43 expref: 23 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.714082:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af55000/0x651a07d11884399f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c27 expref: 22 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.714093:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:3.0:1787380540.714099:0:14221:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380540.714310:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.714325:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380540.714365:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380540.714431:0:14221:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787380540.714468:0:14221:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b5451e6 reply state 00000000fbb5bc5e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380540.714478:0:14221:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380540.714868:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+24:14446:x1874203915704448:12345-192.168.206.14@tcp:36:dd.0 Request processed in 916us (1152us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787380540.714876:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 35 00000020:00080000:3.0:1787380540.714881:0:14221:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787380540.720213:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.720230:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.720238:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.720244:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380540.720249:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.720274:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.720290:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380540.720293:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380540.720298:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380540.720303:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d1188439fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380540.815911:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380540.816009:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915704704 00000100:00100000:1.0:1787380540.816020:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915704704 00000100:00100000:1.0:1787380540.816079:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:1.0:1787380540.816090:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+23:14446:x1874203915704704:12345-192.168.206.14@tcp:35:dd.0 00000100:00100000:1.0:1787380540.816383:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+24:14446:x1874203915704704:12345-192.168.206.14@tcp:35:dd.0 Request processed in 294us (481us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1787380540.816391:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:0.0:1787380541.021478:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380541.021606:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915704832 00000100:00100000:2.0:1787380541.021624:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915704832 00000100:00100000:2.0:1787380541.021695:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00100000:2.0:1787380541.021705:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+24:14460:x1874203915704832:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:2.0:1787380541.021729:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380541.021760:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843a01 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c4a expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.021823:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.021837:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.021848:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.021861:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.021881:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.021888:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022002:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a16 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022012:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022019:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380541.022052:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787380541.022056:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380541.022090:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022101:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a16 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022109:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022115:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022122:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022138:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380541.022142:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022149:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022160:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:2.0:1787380541.022163:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380541.022166:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022172:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a08 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022185:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022192:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022198:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022203:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380541.022206:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022211:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022228:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d969371af00) 00010000:00010000:2.0:1787380541.022230:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380541.022233:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022239:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022269:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843a01 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c4a expref: 26 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022282:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a16 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c4a expref: 25 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.022289:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380541.022291:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380541.022293:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3800, rc 0) 00000100:00100000:2.0:1787380541.022413:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+25:14460:x1874203915704832:12345-192.168.206.14@tcp:101:stat.0 Request processed in 709us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380541.022421:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 36 00000100:00080000:0.0:1787380541.025861:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380541.087131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.087298:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915705088 00000100:00100000:1.0:1787380541.087318:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915705088 00000100:00100000:1.0:1787380541.087417:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 37 00000100:00100000:1.0:1787380541.087427:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+25:14466:x1874203915705088:12345-192.168.206.14@tcp:36:truncate.0 00010000:00010000:1.0:1787380541.087477:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380541.087570:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a16 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c4a expref: 25 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.087588:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380541.087592:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380541.087851:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.087865:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.087875:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380541.087921:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787380541.088244:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d14d46b9 reply state 000000008224dfbf transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380541.088253:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380541.089014:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+27:14466:x1874203915705088:12345-192.168.206.14@tcp:36:truncate.0 Request processed in 1584us (1886us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787380541.089025:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 37 00000020:00080000:1.0:1787380541.089030:0:14222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787380541.093119:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.093135:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.093143:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.093170:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515ec00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380541.093174:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.093182:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.093197:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380541.093200:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380541.093204:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.093210:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843a1d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380541.208787:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380541.210286:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915705216 00000100:00100000:2.0:1787380541.210300:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915705216 00000100:00100000:2.0:1787380541.210688:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:2.0:1787380541.210700:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+26:14480:x1874203915705216:12345-192.168.206.14@tcp:101:stat.0 00010000:00010000:2.0:1787380541.210723:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380541.210742:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843a24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c51 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210802:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210816:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210827:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210869:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210877:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210884:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210976:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210984:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.210991:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380541.211026:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1787380541.211031:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380541.211050:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211060:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211068:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211074:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211091:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211097:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2200 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380541.211101:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211108:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211120:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:2.0:1787380541.211124:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380541.211128:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211135:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a2b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211149:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211155:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211160:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211165:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380541.211167:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211255:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211264:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d969371af00) 00010000:00010000:2.0:1787380541.211267:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380541.211270:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.211275:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.212380:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843a24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 28 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.212414:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 27 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.212423:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380541.212426:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380541.212429:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff3800, rc 0) 00000100:00100000:2.0:1787380541.212571:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+27:14480:x1874203915705216:12345-192.168.206.14@tcp:101:stat.0 Request processed in 1871us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380541.212583:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 38 00000100:00100000:1.0:1787380541.291917:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.292641:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915705472 00000100:00100000:3.0:1787380541.292652:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915705472 00000100:00100000:3.0:1787380541.292718:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:3.0:1787380541.292741:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9587461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+27:14490:x1874203915705472:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380541.292761:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380541.292781:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c58 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380541.292888:0:14221:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787380541.293146:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c58 expref: 29 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.293160:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:3.0:1787380541.293163:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380541.293168:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c58 expref: 29 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.293182:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163be00, rc 0) 00000100:00100000:3.0:1787380541.293246:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9587461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+28:14490:x1874203915705472:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 507us (1339us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1787380541.293254:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 39 00000100:00100000:3.0:1787380541.298518:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.298557:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.298590:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.298620:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.298643:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915705856 00000100:00100000:3.0:1787380541.298652:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915705856 00000100:00100000:3.0:1787380541.298701:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915706112 00000100:00100000:3.0:1787380541.298703:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915706112 00000100:00100000:3.0:1787380541.298713:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915705728 00000100:00100000:3.0:1787380541.298715:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915705728 00000100:00100000:3.0:1787380541.298742:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:3.0:1787380541.298750:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2353:x1874203915705856:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380541.298811:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2353:x1874203915705856:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 62us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.298817:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 9 00000100:00100000:3.0:1787380541.298831:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:3.0:1787380541.298837:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2353:x1874203915706112:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380541.298854:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2353:x1874203915706112:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 18us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.298860:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:3.0:1787380541.298869:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1787380541.298874:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2353:x1874203915705728:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380541.298891:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2353:x1874203915705728:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 17us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.298896:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00080000:3.0:1787380541.298910:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380541.298914:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380541.298937:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.298985:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.299045:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915706240 00000100:00100000:3.0:1787380541.299048:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915706240 00000100:00100000:3.0:1787380541.299066:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:3.0:1787380541.299071:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2353:x1874203915706240:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380541.299094:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83f5759c-3f6c-4648-962a-0ba61afad3eb+5:2353:x1874203915706240:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 23us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.299109:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00080000:3.0:1787380541.299120:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380541.299141:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915705984 00000100:00100000:3.0:1787380541.299144:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915705984 00000100:00080000:3.0:1787380541.299156:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380541.299174:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:3.0:1787380541.299179:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+11:2353:x1874203915705984:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:3.0:1787380541.299208:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83f5759c-3f6c-4648-962a-0ba61afad3eb+11:2353:x1874203915705984:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.299214:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 22 00000100:00100000:0.0:1787380541.300000:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915705600 00000100:00100000:0.0:1787380541.300008:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915705600 00000100:00100000:0.0:1787380541.300050:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:0.0:1787380541.300056:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:2353:x1874203915705600:12345-192.168.206.14@tcp:400:kworker.0 00000100:00100000:0.0:1787380541.300101:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66f4b893-e0f2-4d86-a3f0-eb1a2023213c+13:2353:x1874203915705600:12345-192.168.206.14@tcp:400:kworker.0 Request processed in 46us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380541.300116:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 120 00000100:00100000:3.0:1787380541.303000:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.303210:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915706496 00000100:00100000:1.0:1787380541.303220:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915706496 00000100:00100000:1.0:1787380541.303286:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:1.0:1787380541.303296:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5b05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+28:14490:x1874203915706496:12345-192.168.206.14@tcp:35:lfs.0 00000100:00100000:1.0:1787380541.304050:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5b05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+29:14490:x1874203915706496:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 750us (1054us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787380541.304060:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:2.0:1787380541.366046:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.366147:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915706752 00000100:00100000:1.0:1787380541.366158:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915706752 00000100:00100000:1.0:1787380541.366220:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:1.0:1787380541.366231:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+29:14496:x1874203915706752:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:1.0:1787380541.366254:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380541.366274:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118843a4e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c5f expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.366405:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.366419:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 30 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.366427:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 30 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.366435:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.366471:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 30 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.366504:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 30 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380541.366517:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935614080:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380541.366790:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 30 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.366801:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 30 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380541.366810:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935614208:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380541.366848:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787380541.368547:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380541.370429:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380541.370533:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915706880 00000100:00100000:2.0:1787380541.370543:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915706880 00010000:00010000:2.0:1787380541.370606:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 31 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380541.370667:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:2.0:1787380541.370677:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9688ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:2356:x1874203915706880:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380541.370690:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380541.370698:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 31 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.370710:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 31 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.370731:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380541.370736:0:14206:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.370744:0:14206:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.370751:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380541.370815:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9688ef3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:2356:x1874203915706880:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 139us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380541.370823:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00010000:00010000:1.0:1787380541.371469:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843a39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c51 expref: 30 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380541.371488:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d9587462680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935614080:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380541.371499:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935614208:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380541.371523:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380541.372981:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.373056:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915707008 00000100:00100000:1.0:1787380541.373065:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915707008 00010000:00010000:1.0:1787380541.373099:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 30 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380541.373158:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:1.0:1787380541.373168:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+30:2356:x1874203915707008:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380541.373181:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380541.373188:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 30 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.373199:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 30 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.373220:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3a00/0x651a07d11884398a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c20 expref: 30 pid: 14223 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.373235:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380541.373240:0:14207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.373249:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.373256:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.373286:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380541.373357:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+29:2356:x1874203915707008:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 170us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380541.373365:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00010000:00010000:3.0:1787380541.373796:0:14222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.373805:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380541.373822:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787380541.373973:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118843a4e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 30 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.373988:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 29 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.373996:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:3.0:1787380541.373999:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380541.374009:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:3.0:1787380541.374051:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+29:14496:x1874203915706752:12345-192.168.206.14@tcp:101:bash.0 Request processed in 7822us (8013us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787380541.374058:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 40 00000100:00100000:0.0:1787380541.377072:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.377454:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915707264 00000100:00100000:3.0:1787380541.377464:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915707264 00000100:00100000:3.0:1787380541.377558:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 41 00000100:00100000:3.0:1787380541.377575:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+29:14496:x1874203915707264:12345-192.168.206.14@tcp:36:bash.0 00010000:00010000:3.0:1787380541.377798:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.377813:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.377824:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380541.377879:0:16354:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1787380541.377899:0:16354:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f5da310 reply state 000000002bb14edb transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380541.377907:0:16354:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380541.377979:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14496:x1874203915707264:12345-192.168.206.14@tcp:36:bash.0 Request processed in 412us (913us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1787380541.377986:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 41 00000020:00080000:3.0:1787380541.377990:0:16354:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787380541.381006:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00010000:00010000:1.0:1787380541.381170:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.381188:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.381195:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.381201:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380541.381206:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.381213:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.381229:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380541.381232:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380541.381237:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.381244:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a63 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380541.381785:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915707392 00000100:00100000:3.0:1787380541.381795:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915707392 00000100:00100000:3.0:1787380541.381855:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:3.0:1787380541.381865:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:14496:x1874203915707392:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380541.381895:0:14221:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380541.381911:0:14221:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a6a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c66 expref: -99 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.381961:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c66 expref: 32 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.381975:0:14221:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a6a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c66 expref: 32 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.381993:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:3.0:1787380541.381996:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380541.381999:0:14221:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163be00, rc 0) 00000100:00100000:3.0:1787380541.382047:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14496:x1874203915707392:12345-192.168.206.14@tcp:101:bash.0 Request processed in 183us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.382055:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 42 00000100:00100000:0.0:1787380541.387910:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380541.388036:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915707520 00000100:00100000:2.0:1787380541.388046:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915707520 00000100:00100000:2.0:1787380541.388103:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:2.0:1787380541.388113:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14496:x1874203915707520:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380541.388132:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380541.388163:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a71 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c6d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.388260:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.388274:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 33 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.388283:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.388317:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 33 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.388330:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 33 pid: 14222 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380541.388384:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14223:1874203935614336:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380541.388469:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d96ba2d9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380541.391489:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14223:1874203935614336:192.168.206.14@tcp:104: 00010000:00010000:0.0:1787380541.391516:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380541.391592:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.391984:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915707648 00000100:00100000:1.0:1787380541.391992:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915707648 00010000:00010000:1.0:1787380541.392028:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 34 pid: 14222 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380541.392227:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:1.0:1787380541.392238:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+34:2355:x1874203915707648:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380541.392253:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380541.392273:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 34 pid: 14222 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.392285:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 34 pid: 14222 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.392308:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843a55 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c5f expref: 34 pid: 14222 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.392322:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380541.392328:0:14206:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.392369:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.392377:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.392451:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380541.392505:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+33:2355:x1874203915707648:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 268us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380541.392512:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00010000:00010000:2.0:1787380541.392981:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.392990:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380541.393033:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787380541.393038:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787380541.393057:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.393103:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2200/0x651a07d118843a71 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c6d expref: 33 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.393118:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c6d expref: 32 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.393125:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:2.0:1787380541.393128:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380541.393130:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2400, rc 0) 00000100:00100000:2.0:1787380541.393161:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14496:x1874203915707520:12345-192.168.206.14@tcp:101:bash.0 Request processed in 5051us (5260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380541.393168:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 43 00000100:00100000:0.0:1787380541.395943:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.396027:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915707904 00000100:00100000:1.0:1787380541.396037:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915707904 00000100:00100000:1.0:1787380541.396133:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:1.0:1787380541.396143:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14496:x1874203915707904:12345-192.168.206.14@tcp:103:bash.0 00010000:00010000:1.0:1787380541.396158:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787380541.396181:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843a78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c6d expref: 32 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.396217:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a6a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c66 expref: 31 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.396228:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d969371ad00) 00010000:00010000:1.0:1787380541.396239:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380541.396294:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+30:14496:x1874203915707904:12345-192.168.206.14@tcp:103:bash.0 Request processed in 153us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380541.396302:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 2 00000100:00100000:3.0:1787380541.398138:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380541.398220:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915708032 00000100:00100000:0.0:1787380541.398228:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915708032 00000100:00100000:0.0:1787380541.398282:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:0.0:1787380541.398292:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+30:14496:x1874203915708032:12345-192.168.206.14@tcp:58:bash.0 00010000:00010000:0.0:1787380541.398416:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380541.398431:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380541.398442:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787380541.399247:0:14221:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380541.399440:0:14221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787380541.399509:0:14221:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787380541.399610:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+30:14496:x1874203915708032:12345-192.168.206.14@tcp:58:bash.0 Request processed in 1315us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380541.399629:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 44 00000100:00100000:0.0:1787380541.402251:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.402380:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915708160 00000100:00100000:3.0:1787380541.402390:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915708160 00000100:00100000:3.0:1787380541.402448:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 45 00000100:00100000:3.0:1787380541.402457:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+30:14496:x1874203915708160:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:3.0:1787380541.402477:0:16354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380541.402496:0:16354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c74 expref: -99 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.402550:0:16354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.402589:0:16354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c74 expref: 31 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.402617:0:16354:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.402632:0:16354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c74 expref: 31 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.402644:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d96897d4800) 00010000:00010000:3.0:1787380541.402647:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380541.402651:0:16354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c74 expref: 31 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.402657:0:16354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163a400, rc 0) 00000100:00100000:3.0:1787380541.402979:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:14496:x1874203915708160:12345-192.168.206.14@tcp:101:bash.0 Request processed in 522us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.402987:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 45 00000040:00080000:1.0:1787380541.879600:0:14256:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787380541.879609:0:14256:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380541.879646:0:14256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787380541.879651:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787380541.879767:0:14256:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14256:1874203935614464:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787380541.879871:0:14256:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d969f1d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787380541.895086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380541.895332:0:14232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915708288 00000100:00100000:2.0:1787380541.895381:0:14232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915708288 00000100:00100000:2.0:1787380541.895449:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:2.0:1787380541.895460:0:14232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14497:x1874203915708288:12345-192.168.206.14@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787380541.895544:0:14232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14497:x1874203915708288:12345-192.168.206.14@tcp:900:lhsmtool_posix.0 Request processed in 86us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380541.895552:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 0 00000100:00100000:1.0:1787380541.896882:0:14256:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14256:1874203935614464:192.168.206.14@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380541.899658:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.899794:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915708416 00000100:00100000:3.0:1787380541.899804:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915708416 00000100:00100000:3.0:1787380541.899875:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:3.0:1787380541.899886:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:14497:x1874203915708416:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380541.899917:0:14221:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380541.900888:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:14497:x1874203915708416:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 156us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.900901:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 46 00000100:00100000:0.0:1787380541.905560:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.905718:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915708544 00000100:00100000:3.0:1787380541.905727:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915708544 00000100:00100000:3.0:1787380541.905784:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:3.0:1787380541.905794:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:14497:x1874203915708544:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787380541.905864:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.905881:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.905894:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.905955:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.906224:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.906233:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.906498:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.906510:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.906517:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380541.906556:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787380541.906582:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787380541.907117:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907132:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907139:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907146:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907152:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163be00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380541.907156:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907163:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907176:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d969371ae00) 00010000:00010000:3.0:1787380541.907179:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380541.907184:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907190:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843a8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907205:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907212:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907230:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907236:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380541.907239:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907246:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907254:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d968727fb00) 00010000:00010000:3.0:1787380541.907667:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380541.907672:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907679:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843a94 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907698:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907703:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907708:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907714:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380541.907716:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907732:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907742:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d96897d4800) 00010000:00010000:3.0:1787380541.907744:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380541.907747:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.907752:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843a9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380541.907849:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:14497:x1874203915708544:12345-192.168.206.14@tcp:34:lhsmtool_posix.0 Request processed in 2052us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.907860:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 47 00000100:00100000:0.0:1787380541.915274:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.915381:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915708800 00000100:00100000:1.0:1787380541.915404:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915708800 00000100:00100000:1.0:1787380541.915461:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:1.0:1787380541.915470:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+31:14497:x1874203915708800:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380541.915490:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380541.915509:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aa2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c7b expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915600:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915640:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915650:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380541.915663:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787380541.915753:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915761:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915767:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915772:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d96b515fe00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380541.915777:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915784:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915796:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d96897d4800) 00010000:00010000:1.0:1787380541.915799:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380541.915804:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915810:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843aa9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915867:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aa2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c7b expref: 33 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915883:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d969371ae00) 00010000:00010000:1.0:1787380541.915885:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380541.915890:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aa2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c7b expref: 33 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.915900:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:1.0:1787380541.915958:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14497:x1874203915708800:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 489us (694us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1787380541.915966:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 48 00000100:00100000:0.0:1787380541.920715:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.924856:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915708928 00000100:00100000:3.0:1787380541.924871:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915708928 00000100:00100000:3.0:1787380541.924943:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:3.0:1787380541.924953:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14497:x1874203915708928:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380541.925007:0:16354:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380541.925140:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14497:x1874203915708928:12345-192.168.206.14@tcp:53:lhsmtool_posix.0 Request processed in 187us (4431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.925148:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 49 00000100:00100000:0.0:1787380541.929121:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.929563:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915709184 00000100:00100000:1.0:1787380541.929573:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915709184 00000100:00100000:1.0:1787380541.929637:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:1.0:1787380541.929647:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+32:14497:x1874203915709184:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380541.929668:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380541.929687:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843ab7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c82 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787380541.930329:0:14222:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1787380541.930747:0:14222:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787380541.930812:0:14222:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1787380541.932175:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843abe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.932193:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843abe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.932205:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843abe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.932279:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843ab7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c82 expref: 35 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.932298:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843abe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c82 expref: 34 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.932307:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d300) 00010000:00010000:1.0:1787380541.932310:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380541.932314:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fe00, rc 0) 00000100:00100000:1.0:1787380541.932752:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+34:14497:x1874203915709184:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 3104us (3637us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787380541.932763:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 50 00000100:00100000:1.0:1787380541.936703:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.936807:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915709440 00000100:00100000:3.0:1787380541.936816:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915709440 00000100:00100000:3.0:1787380541.936938:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:3.0:1787380541.936948:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+34:14497:x1874203915709440:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380541.937000:0:16354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380541.937039:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843abe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c82 expref: 34 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937057:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d300) 00010000:00010000:3.0:1787380541.937068:0:16354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380541.937090:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937102:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937112:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937125:0:16354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937131:0:16354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937138:0:16354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937207:0:16354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937215:0:16354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937221:0:16354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937227:0:16354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380541.937237:0:16354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937244:0:16354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937253:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:3.0:1787380541.937256:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380541.937259:0:16354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937266:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843acc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937276:0:16354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937282:0:16354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937287:0:16354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937292:0:16354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:3.0:1787380541.937295:0:16354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937300:0:16354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937307:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x35f199ec (ffff9d968727fb00) 00010000:00010000:3.0:1787380541.937310:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380541.937318:0:16354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.937324:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ad3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x35f199ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380541.937769:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+33:14497:x1874203915709440:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 821us (1075us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380541.937779:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 51 00000100:00100000:0.0:1787380541.940887:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.940967:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915709568 00000100:00100000:1.0:1787380541.940977:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915709568 00000100:00100000:1.0:1787380541.941030:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:1.0:1787380541.941048:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+33:14497:x1874203915709568:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380541.941069:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380541.941092:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843ada lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c89 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.941128:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118843ae1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.941141:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118843ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.941169:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118843ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.941272:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843ada lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c89 expref: 35 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.941288:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515e600/0x651a07d118843ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c89 expref: 34 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.941296:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380541.941299:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380541.941302:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515e600, rc 0) 00000100:00100000:1.0:1787380541.941383:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+34:14497:x1874203915709568:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 343us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380541.941401:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 52 00000100:00100000:0.0:1787380541.945500:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.945629:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915709824 00000100:00100000:3.0:1787380541.945638:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915709824 00000100:00100000:3.0:1787380541.945695:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 53 00000100:00100000:3.0:1787380541.945704:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+34:14497:x1874203915709824:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380541.945787:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.945803:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380541.945815:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380541.946210:0:14223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787380541.946220:0:14223:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 492257881057ns, next at 493257879190ns, rc = 0 00000004:00010000:3.0:1787380541.946305:0:14223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064b59bdd reply state 00000000a4af7136 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380541.946314:0:14223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380541.946454:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+36:14497:x1874203915709824:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 749us (961us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1787380541.946481:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 53 00010000:00010000:2.0:1787380541.949000:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.949016:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.949024:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.949049:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163a600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380541.949053:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.949060:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.949075:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:2.0:1787380541.949078:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787380541.949082:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.949088:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a600/0x651a07d118843ae8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380541.950552:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.950785:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915709952 00000100:00100000:1.0:1787380541.950794:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915709952 00000100:00100000:1.0:1787380541.950859:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:1.0:1787380541.950868:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+35:14497:x1874203915709952:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380541.950890:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380541.950907:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c90 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.950963:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 36 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.950977:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 36 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.951010:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380541.951013:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380541.951017:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515f400, rc 0) 00000100:00100000:1.0:1787380541.951076:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+36:14497:x1874203915709952:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 208us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380541.951083:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 54 00000100:00100000:0.0:1787380541.954331:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.954491:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915710080 00000100:00100000:3.0:1787380541.954499:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915710080 00000100:00100000:3.0:1787380541.954603:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:3.0:1787380541.954614:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+5:2356:x1874203915710080:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787380541.954939:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:2356:x1874203915710080:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 325us (614us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787380541.954948:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 10 00000100:00100000:0.0:1787380541.957506:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.957589:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915710336 00000100:00100000:3.0:1787380541.957607:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915710336 00000100:00100000:3.0:1787380541.957662:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1787380541.957673:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+36:14497:x1874203915710336:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787380541.957897:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+37:14497:x1874203915710336:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 225us (399us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787380541.957905:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:0.0:1787380541.960066:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.960200:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915710592 00000100:00100000:3.0:1787380541.960208:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915710592 00000100:00100000:3.0:1787380541.960262:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:3.0:1787380541.960272:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+37:14497:x1874203915710592:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787380541.960420:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+37:14497:x1874203915710592:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380541.960429:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 55 00000100:00100000:0.0:1787380541.962198:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.962285:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915710720 00000100:00100000:1.0:1787380541.962294:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915710720 00000100:00100000:1.0:1787380541.962376:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:1.0:1787380541.962386:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+37:14497:x1874203915710720:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380541.962416:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380541.962434:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843af6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c97 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.962495:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843afd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.962509:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843afd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.962520:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843afd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380541.962556:0:14222:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787380541.962574:0:14222:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843afd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.963070:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515ec00/0x651a07d118843af6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c97 expref: 39 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.963106:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843afd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c97 expref: 38 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380541.963115:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380541.963118:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787380541.963121:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d96b515fe00, rc 0) 00000100:00100000:1.0:1787380541.963219:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+38:14497:x1874203915710720:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 833us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380541.963228:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 56 00000100:00100000:1.0:1787380541.966384:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380541.966500:0:14859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915710848 00000100:00100000:2.0:1787380541.966511:0:14859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915710848 00000100:00100000:2.0:1787380541.966623:0:14859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:2.0:1787380541.966633:0:14859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+6:2355:x1874203915710848:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380541.966648:0:14859:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380541.966667:0:14859:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6c9e expref: -99 pid: 14859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380541.966692:0:14859:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89433d, blocks: 0x1 00010000:00010000:2.0:1787380541.966708:0:14859:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787380541.966713:0:14859:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380541.966720:0:14859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 7 pid: 14859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.966755:0:14859:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 7 pid: 14859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380541.966767:0:14859:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2200, rc 0) 00000100:00100000:2.0:1787380541.966826:0:14859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:2355:x1874203915710848:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 194us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380541.966834:0:14859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 11 00000100:00100000:3.0:1787380541.969076:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380541.969165:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915711104 00000100:00100000:1.0:1787380541.969175:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915711104 00000100:00100000:1.0:1787380541.969233:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:1.0:1787380541.969242:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+38:14497:x1874203915711104:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787380541.969361:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+38:14497:x1874203915711104:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380541.969370:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 57 00000100:00100000:1.0:1787380541.971372:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380541.971455:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915711232 00000100:00100000:3.0:1787380541.971475:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915711232 00000100:00100000:3.0:1787380541.971525:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:3.0:1787380541.971535:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+38:14497:x1874203915711232:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787380542.014151:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:3.0:1787380542.014168:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1787380542.014174:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:3.0:1787380542.014206:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1787380542.014215:0:5808:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1787380542.014220:0:5808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787380542.014400:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935614592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787380542.014470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380542.014547:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935614592 00000100:00100000:3.0:1787380542.014555:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935614592 00000100:00100000:3.0:1787380542.014616:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380542.014624:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874203935614592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787380542.014767:0:14857:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787380542.014771:0:14857:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787380542.014773:0:14857:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787380542.014775:0:14857:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787380541 -> 1787380541 00002000:00010000:3.0:1787380542.014778:0:14857:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787380542.014817:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874203935614592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (347us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787380542.014825:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787380542.014923:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787380542.014957:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d95877cdc00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787380542.014964:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3300:1874203935614592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787380542.015113:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+13:14497:x1874203915711232:12345-192.168.206.14@tcp:44:lhsmtool_posix.0 Request processed in 43575us (43771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380542.015121:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 58 00000100:00100000:1.0:1787380542.017466:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380542.017548:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915711360 00000100:00100000:0.0:1787380542.017558:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915711360 00000100:00100000:0.0:1787380542.017620:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:0.0:1787380542.017629:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:2356:x1874203915711360:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787380542.017733:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:2356:x1874203915711360:12345-192.168.206.14@tcp:16:lhsmtool_posix.0 Request processed in 105us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380542.017741:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:3.0:1787380542.020105:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380542.020212:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915711616 00000100:00100000:1.0:1787380542.020221:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915711616 00000100:00100000:1.0:1787380542.020278:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 59 00000100:00100000:1.0:1787380542.020297:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+13:14497:x1874203915711616:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787380542.020402:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380542.020431:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515fe00/0x651a07d118843afd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c97 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.020450:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380542.020455:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380542.020485:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.020498:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.020508:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380542.021045:0:14223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009ef20df2 reply state 00000000b5d51e94 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380542.021056:0:14223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380542.021158:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+14:14497:x1874203915711616:12345-192.168.206.14@tcp:36:lhsmtool_posix.0 Request processed in 861us (1061us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1787380542.021167:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 59 00010000:00010000:2.0:1787380542.023431:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.023446:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.023453:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.023459:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e000 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380542.023464:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.023471:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.023488:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:2.0:1787380542.023491:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380542.023495:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.023521:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e000/0x651a07d118843b0b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380542.025070:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380542.025244:0:14857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915711744 00000100:00100000:1.0:1787380542.025253:0:14857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915711744 00000100:00100000:1.0:1787380542.025302:0:14857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:1.0:1787380542.025312:0:14857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:14497:x1874203915711744:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380542.025331:0:14857:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380542.025401:0:14857:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6ca5 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.025446:0:14857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 8 pid: 14859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.025455:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380542.025459:0:14857:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380542.025464:0:14857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 8 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.025495:0:14857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 8 pid: 14859 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.025509:0:14857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 8 pid: 14859 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380542.025523:0:14857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14857:1874203935614720:192.168.206.14@tcp:104: 00000100:00100000:1.0:1787380542.025607:0:14857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9692393300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380542.028088:0:14857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14857:1874203935614720:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380542.028123:0:14857:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 8 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.028145:0:14857:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9688e1e400, rc 0) 00000100:00100000:3.0:1787380542.028195:0:14857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+8:14497:x1874203915711744:12345-192.168.206.14@tcp:101:lhsmtool_posix.0 Request processed in 2884us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380542.028203:0:14857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:2.0:1787380542.030311:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380542.030441:0:16241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915711872 00000100:00100000:3.0:1787380542.030450:0:16241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915711872 00010000:00010000:3.0:1787380542.030489:0:16241:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 8 pid: 14859 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380542.030527:0:16241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:3.0:1787380542.030537:0:16241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+8:2356:x1874203915711872:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380542.030551:0:16241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380542.030574:0:16241:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 8 pid: 14859 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.030588:0:16241:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 8 pid: 14859 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.030621:0:16241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b35915/0x651a07d118843b04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c9e expref: 8 pid: 14859 timeout: 592 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.030656:0:16241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380542.030661:0:16241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380542.030668:0:16241:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 7 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.030679:0:16241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 7 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.030717:0:16241:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 7 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380542.030731:0:16241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16241:1874203935614848:192.168.206.14@tcp:105: 00000100:00100000:3.0:1787380542.030956:0:16241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9688e5c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380542.036181:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380542.036320:0:16241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16241:1874203935614848:192.168.206.14@tcp:105: 00010000:00010000:3.0:1787380542.036379:0:16241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380542.036453:0:16241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:2356:x1874203915711872:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 5917us (6149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380542.036464:0:16241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:2.0:1787380542.036552:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915712000 00000100:00100000:2.0:1787380542.036559:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915712000 00000100:00100000:2.0:1787380542.036620:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:2.0:1787380542.036629:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:2355:x1874203915712000:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787380542.036828:0:15590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787380542.036832:0:15590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787380541 00002000:00010000:2.0:1787380542.036834:0:15590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787380539 00002000:00010000:2.0:1787380542.036837:0:15590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787380541 -> 1787380541 00002000:00010000:2.0:1787380542.036839:0:15590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787380542.036864:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+8:2355:x1874203915712000:12345-192.168.206.14@tcp:2:lhsmtool_posix.0 Request processed in 236us (691us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787380542.036871:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:2.0:1787380542.040694:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380542.040781:0:14856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915712128 00000100:00100000:3.0:1787380542.040791:0:14856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915712128 00000100:00100000:3.0:1787380542.040854:0:14856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:3.0:1787380542.040864:0:14856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+8:2353:x1874203915712128:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787380542.040906:0:14856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.040940:0:14856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 8 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.040948:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380542.040953:0:14856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380542.040957:0:14856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.040990:0:14856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 8 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.041004:0:14856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 8 pid: 14857 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380542.041017:0:14856:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14856:1874203935614976:192.168.206.14@tcp:104: 00000100:00100000:3.0:1787380542.041103:0:14856:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d9688e5c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380542.043873:0:14856:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d95877cc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14856:1874203935614976:192.168.206.14@tcp:104: 00010000:00010000:3.0:1787380542.043903:0:14856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380542.045248:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380542.046287:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915712256 00000100:00100000:1.0:1787380542.046299:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915712256 00010000:00010000:1.0:1787380542.046358:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 9 pid: 14857 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380542.046450:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:1.0:1787380542.046460:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+9:2355:x1874203915712256:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380542.046475:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380542.046512:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 9 pid: 14857 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.046525:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 9 pid: 14857 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.046547:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018b64599/0x651a07d118843b12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6ca5 expref: 9 pid: 14857 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.046564:0:14208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380542.046578:0:14208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380542.046583:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.046599:0:14208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.046630:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380542.046692:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b07ef607-e154-4d63-8e5d-8040f62f63ba+8:2355:x1874203915712256:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 233us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380542.046700:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00010000:00010000:3.0:1787380542.046764:0:14856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046774:0:14856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046806:0:14856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046815:0:14856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046823:0:14856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046841:0:14856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:3.0:1787380542.046845:0:14856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046855:0:14856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046867:0:14856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.046874:0:14856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005363871a/0x651a07d118843b19 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380542.046924:0:14856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:2353:x1874203915712128:12345-192.168.206.14@tcp:1:lhsmtool_posix.0 Request processed in 6061us (6241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380542.046941:0:14856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:3.0:1787380542.049526:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380542.049636:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915712512 00000100:00100000:2.0:1787380542.049646:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915712512 00000100:00100000:2.0:1787380542.049703:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 60 00000100:00100000:2.0:1787380542.049714:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+13:14497:x1874203915712512:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787380542.049789:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.049806:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.049842:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.050070:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.050082:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.050091:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.050123:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.050136:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 14 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380542.050149:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935615104:192.168.206.14@tcp:104: 00000100:00100000:2.0:1787380542.050317:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ae8cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380542.053315:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935615104:192.168.206.14@tcp:104: 00010000:00010000:1.0:1787380542.053379:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380542.056697:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380542.057171:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915712640 00000100:00100000:1.0:1787380542.057182:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915712640 00010000:00010000:1.0:1787380542.057235:0:14206:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 15 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380542.057276:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 16 00000100:00100000:1.0:1787380542.057285:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+15:2354:x1874203915712640:12345-192.168.206.14@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380542.057299:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380542.057305:0:14206:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 15 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.057318:0:14206:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 15 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.057369:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d96b515f400/0x651a07d118843aef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c90 expref: 15 pid: 14222 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.057385:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380542.057401:0:14206:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.057410:0:14206:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.057416:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.057450:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380542.057507:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+14:2354:x1874203915712640:12345-192.168.206.14@tcp:103:ldlm_bl.0 Request processed in 222us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380542.057514:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 16 00010000:00010000:2.0:1787380542.057763:0:14222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.057772:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380542.057975:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1787380542.058123:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1787380542.058171:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1787380542.058264:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14222:1874203935615232:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787380542.058418:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380542.058448:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ae8ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380542.059313:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935615232 00000100:00100000:1.0:1787380542.059322:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935615232 00000100:00100000:1.0:1787380542.059408:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380542.059418:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14222:x1874203935615232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787380542.059500:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14222:x1874203935615232:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380542.059507:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380542.060813:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14222:1874203935615232:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787380542.063845:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1787380542.063931:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14222:1874203935615360:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787380542.063988:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380542.064017:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ae8c540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380542.064539:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935615360 00000100:00100000:1.0:1787380542.064547:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935615360 00000100:00100000:1.0:1787380542.064605:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380542.064613:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14222:x1874203935615360:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787380542.064778:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14222:x1874203935615360:12345-0@lo:1000:mdt00_001.0 Request processed in 166us (789us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787380542.064786:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380542.065566:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14222:1874203935615360:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787380542.065618:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065628:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065635:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065641:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380542.065646:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065652:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065666:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:2.0:1787380542.065669:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380542.065674:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065696:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3800/0x651a07d118843b27 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065729:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065736:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065742:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065747:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968af54c00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380542.065749:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065755:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065764:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d96897d4800) 00010000:00010000:2.0:1787380542.065766:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380542.065773:0:14222:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c74 expref: 17 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065783:0:14222:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c74 expref: 17 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065792:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c74 expref: 17 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.065869:0:14222:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163a400/0x651a07d118843a86 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6c74 expref: 17 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380542.065883:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935615488:192.168.206.14@tcp:105: 00000100:00100000:2.0:1787380542.065947:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d968ae8cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380542.070451:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380542.070580:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915712768 00000100:00100000:0.0:1787380542.070589:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915712768 00000100:00100000:0.0:1787380542.070652:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:0.0:1787380542.070673:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d95877cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+18:14496:x1874203915712768:12345-192.168.206.14@tcp:49:bash.0 00000100:00100000:0.0:1787380542.070798:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+18:14496:x1874203915712768:12345-192.168.206.14@tcp:49:bash.0 Request processed in 126us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380542.070806:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 12 00000100:00100000:2.0:1787380542.071057:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14222:1874203935615488:192.168.206.14@tcp:105: 00010000:00010000:2.0:1787380542.071082:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071092:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968af54c00/0x651a07d118843a7f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071121:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071134:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071144:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071152:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071158:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071164:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071180:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff2400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380542.071184:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071191:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071204:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d96897d4800) 00010000:00010000:2.0:1787380542.071207:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380542.071210:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071215:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff2400/0x651a07d118843b2e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071225:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071230:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071235:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071240:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9698ff3e00 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:2.0:1787380542.071242:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071247:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071267:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d96897d4800) 00010000:00010000:2.0:1787380542.071269:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380542.071272:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.071277:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9698ff3e00/0x651a07d118843b20 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380542.071502:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d95877cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+17:14497:x1874203915712512:12345-192.168.206.14@tcp:57:lhsmtool_posix.0 Request processed in 21789us (21986us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787380542.071510:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 60 00000020:00080000:2.0:1787380542.071515:0:14222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787380542.071705:0:14256:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787380542.071711:0:14256:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380542.071737:0:14256:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787380542.071744:0:14256:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787380542.076772:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380542.077001:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915713024 00000100:00100000:3.0:1787380542.077010:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915713024 00000100:00100000:3.0:1787380542.077064:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 13 00000100:00100000:3.0:1787380542.077074:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+17:14497:x1874203915713024:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787380542.078225:0:14224:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787380542.078692:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1787380542.078752:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.078768:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.078779:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.078787:0:14224:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.078793:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.078800:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.078937:0:14224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787380542.079075:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+19:14497:x1874203915713024:12345-192.168.206.14@tcp:35:lhsmtool_posix.0 Request processed in 1999us (2307us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1787380542.079085:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 13 00000020:00080000:3.0:1787380542.079091:0:14224:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787380542.083979:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:2.0:1787380542.084111:0:15590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915713152 00000100:00100000:2.0:1787380542.084120:0:15590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915713152 00000100:00100000:2.0:1787380542.084179:0:15590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:2.0:1787380542.084189:0:15590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+7:14496:x1874203915713152:12345-192.168.206.14@tcp:101:bash.0 00010000:00010000:2.0:1787380542.084207:0:15590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380542.084227:0:15590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014068854/0x651a07d118843b3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6cac expref: -99 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380542.084255:0:15590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a89433d, atime: 0x6a89433b, ctime: 0x6a89433d, blocks: 0x1 00010000:00010000:2.0:1787380542.084276:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787380542.084281:0:15590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380542.084290:0:15590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014068854/0x651a07d118843b3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6cac expref: 8 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.084305:0:15590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000014068854/0x651a07d118843b3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6cac expref: 8 pid: 15590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380542.084331:0:15590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d9698ff2400, rc 0) 00000100:00100000:2.0:1787380542.084422:0:15590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+8:14496:x1874203915713152:12345-192.168.206.14@tcp:101:bash.0 Request processed in 234us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380542.084430:0:15590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 17 00000100:00100000:2.0:1787380542.087856:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:0.0:1787380542.087956:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915713408 00000100:00100000:0.0:1787380542.087967:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915713408 00000100:00100000:0.0:1787380542.088022:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 14 00000100:00100000:0.0:1787380542.088032:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+19:14496:x1874203915713408:12345-192.168.206.14@tcp:35:bash.0 00000001:00080000:0.0:1787380542.088335:0:14225:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1787380542.088492:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd25ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+21:14496:x1874203915713408:12345-192.168.206.14@tcp:35:bash.0 Request processed in 461us (645us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1787380542.088500:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 14 00000020:00080000:0.0:1787380542.088505:0:14225:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380542.091171:0:15594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380542.091184:0:15594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.091194:0:15594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d968163b000 already unused, calling callback (ffffffffc179be90) 00010000:00010000:1.0:1787380542.091198:0:15594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.091207:0:15594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.091245:0:15594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d968911d400) 00010000:00010000:1.0:1787380542.091248:0:15594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787380542.091252:0:15594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.091270:0:15594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163b000/0x651a07d118843b35 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.091288:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380542.091290:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380542.091291:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380542.186658:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380542.186771:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915713664 00000100:00100000:3.0:1787380542.186781:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915713664 00000100:00100000:3.0:1787380542.186852:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:3.0:1787380542.186862:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96911bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+21:14507:x1874203915713664:12345-192.168.206.14@tcp:101:lfs.0 00010000:00010000:3.0:1787380542.186886:0:16354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380542.186905:0:16354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5094e7b038f6cb3 expref: -99 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380542.187161:0:16354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787380542.187377:0:16354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843b43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6cb3 expref: 23 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.187402:0:16354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d96897d4a00) 00010000:00010000:3.0:1787380542.187406:0:16354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380542.187411:0:16354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d968163be00/0x651a07d118843b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.14@tcp remote: 0x5094e7b038f6cb3 expref: 23 pid: 16354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380542.187424:0:16354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d968163be00, rc 0) 00000100:00100000:3.0:1787380542.187482:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96911bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b07ef607-e154-4d63-8e5d-8040f62f63ba+22:14507:x1874203915713664:12345-192.168.206.14@tcp:101:lfs.0 Request processed in 622us (833us total) trans 8589934633 rc 301/301 00000100:00100000:3.0:1787380542.187490:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 61 00000100:00100000:3.0:1787380542.190680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:1.0:1787380542.191041:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915713792 00000100:00100000:1.0:1787380542.191052:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915713792 00000100:00100000:1.0:1787380542.191120:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:1.0:1787380542.191130:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+22:14507:x1874203915713792:12345-192.168.206.14@tcp:34:lfs.0 00010000:00010000:1.0:1787380542.191197:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191213:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191225:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191238:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191245:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191262:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191564:0:14221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191574:0:14221:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191583:0:14221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380542.191623:0:14221:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191634:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191640:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191647:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191653:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e400 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380542.191657:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191665:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191676:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d969371a100) 00010000:00010000:1.0:1787380542.191679:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380542.191683:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191695:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e400/0x651a07d118843b51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191707:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191713:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191719:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191723:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1e600 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380542.191726:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191732:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191739:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d968911d700) 00010000:00010000:1.0:1787380542.191741:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380542.191744:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191749:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1e600/0x651a07d118843b58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191764:0:14221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191770:0:14221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191783:0:14221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191788:0:14221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d9688e1f800 already unused, calling callback (ffffffffc21d74f0) 00010000:00010000:1.0:1787380542.191791:0:14221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191798:0:14221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191806:0:14221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d96897d4800) 00010000:00010000:1.0:1787380542.191808:0:14221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380542.191811:0:14221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380542.191816:0:14221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d9688e1f800/0x651a07d118843b5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14221 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380542.191904:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b07ef607-e154-4d63-8e5d-8040f62f63ba+22:14507:x1874203915713792:12345-192.168.206.14@tcp:34:lfs.0 Request processed in 765us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380542.191911:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 62 00000100:00100000:3.0:1787380542.199638:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96b5d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935615616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380542.199726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380542.199776:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935615616 00000100:00100000:0.0:1787380542.199785:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935615616 00000100:00100000:1.0:1787380542.199906:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380542.199917:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935615744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380542.199948:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380542.202409:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.14@tcp (source: 12345-192.168.206.14@tcp) 00000100:00100000:3.0:1787380542.202448:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203915714048 00000100:00100000:3.0:1787380542.202456:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203915714048 00000100:00100000:3.0:1787380542.202498:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:3.0:1787380542.202507:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+22:14507:x1874203915714048:12345-192.168.206.14@tcp:35:lfs.0 00000100:00080000:2.0:1787380542.202720:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380542.202913:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935616000:0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.202958:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b07ef607-e154-4d63-8e5d-8040f62f63ba+23:14507:x1874203915714048:12345-192.168.206.14@tcp:35:lfs.0 Request processed in 450us (566us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1787380542.202960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380542.202970:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.14@tcp, seq: 15 00000100:00100000:3.0:1787380542.202998:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935616256:0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203026:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380542.203048:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380542.203053:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935616128:0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203072:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380542.203095:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935616000 00000100:00100000:3.0:1787380542.203099:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935616000 00000100:00100000:3.0:1787380542.203120:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935616256 00000100:00100000:3.0:1787380542.203122:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935616256 00000100:00100000:2.0:1787380542.203133:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380542.203143:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935615872:0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203144:0:16354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935616128 00000100:00100000:3.0:1787380542.203148:0:16354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935616128 00000100:00100000:3.0:1787380542.203170:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380542.203179:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935616000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380542.203186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380542.203224:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874203935616000:12345-0@lo:400:kworker.0 Request processed in 46us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380542.203232:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787380542.203240:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874203935616000:0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203247:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380542.203254:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935616256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203292:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874203935616256:12345-0@lo:400:kworker.0 Request processed in 38us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380542.203298:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380542.203310:0:16354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380542.203316:0:16354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935616128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203374:0:16354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874203935616128:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380542.203377:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935615872 00000100:00100000:2.0:1787380542.203383:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935615872 00000100:00100000:3.0:1787380542.203385:0:16354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787380542.203417:0:14217:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380542.203431:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787380542.203440:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d9699051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3300:x1874203935615872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203442:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3302:1874203935616128:0@lo:400:kworker.0 00000100:00100000:3.0:1787380542.203457:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3302:1874203935616256:0@lo:400:kworker.0 00000100:00100000:2.0:1787380542.203488:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d9699051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c6627fe6-651b-4b45-bfed-0a36822f804a+19:3300:x1874203935615872:12345-0@lo:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380542.203495:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787380542.203535:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c6627fe6-651b-4b45-bfed-0a36822f804a:3300:1874203935615872:0@lo:400:kworker.0 00000100:00100000:0.0:1787380542.203681:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203935615744 00000100:00100000:0.0:1787380542.203686:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203935615744 00000100:00100000:0.0:1787380542.203704:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380542.203711:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96bd0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935615616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380542.203734:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380542.203765:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96bd0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874203935615616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (4040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380542.203771:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380542.203782:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380542.203786:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d96b5d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935615744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380542.203908:0:14860:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787380542.203936:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d96b5d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874203935615744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380542.203942:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380542.204781:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96bd25c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935615744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380542.204796:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d96b5d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3301:1874203935615616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787380542.392101:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380543.415809:0:14209:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380543.649183:0:16393:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1787380544.439882:0:15594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29605 lines, 29605 kept, 0 dropped, 0 bad.